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Preface 


An integrated course on linear algebra and 
analytical geometry is given to students of the computational 
mathematics and cybernetics department (CMC) of Moscow university 
(MU) during the first two terms of their study (at two lectures a week). 
A lecturer on the subject is presented with some complicated prob¬ 
lems and to clarify these problems, let us make some comparisons 
between this course and the syllabi of similar courses in mathematics 
departments, and in particular the mechanics-and-mathematics 
department of Moscow university. 

The CMC department syllabus includes the greater part of the 
analytical geometry course given at the mechanics-and-mathematics 
department of MU (excluding the affine classification of second order 
lines and surfaces and the projective geometry elements) and the 
whole linear algebra course. The latter comprises, inter alia, topics 
usually omitted at the mechanics-and-mathematics department like, 
for example, singular values of the operators, pseudo solutions of 
systems of linear equations, etc. The specific character of the depart¬ 
ment requires that a lecturer should draw the students’ attention to 
the flexibility of most concepts of classical linear algebra (linear 
dependence, degeneracy, Jordan structure, etc.) and of its methods, 
as well as indicate the approaches for finding stable solutions to 
algebraic problems. To achieve this aim, elements of normal linear 
space theory are introduced into the course in such a way that the 
concrete metric results, such as evaluations of the perturbations of 
a linear system solution and the eigenvalues of a matrix, etc., can 
be attained later. This must all be achieved in less than the time 
taken by the algebra and geometry courses together at the mathemat¬ 
ics departments, and moreover, without lowering the degree of 
mathematical rigor! 

It is clear that without some essential restructuring of the custom¬ 
ary course this would not be possible and it was V. Voyevodin who 
made such an attempt to carry out this restructuring in his book 
Linear Algebra (Mir Publishers, 1983). The book is based on the 
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author’s experience delivering a course of lectures for some years 
at the CMC department. 

Let us indicate some of the particulars of the course devised by 
V. Voyevodin that helped to save his time as a lecturer. 

The notion of linear spaces is easier to grasp after a study of vector 
algebra and so is introduced at the very beginning of the course. 
The customary way of repeated reintroducing linear space theory 
three times usually—first in analytical geometry in relation to sets of 
geometric vectors; then for arithmetic spaces in order to describe the 
structure of the solution sets of linear algebraic equation systems; 
and finally, in the general case—is avoided.- 

In the subsequent chapters, too, the development of geometry and 
algebra takes place simultaneously; furthermore, a new geometric 
notion forms the basis for an n-dimensional general case. Thus, the 
scalar product of geometric vectors serves to introduce Euclidean 
and unitary spaces and a formula for the volume of a three-dimension¬ 
al parallelepiped advances the construction of n-dimensional volume 
theory. Thus, the theory of determinants is considered as an oriented 
volume of a parallelepiped in arithmetic space; straight lines and 
planes in three-dimensional space are a reason to introduce the notion 
of a plane in any linear space, and a geometric problem on inter¬ 
secting hyperplanes illustrates the structure of the solution set of 
a system of linear equations. By contrast there are some examples 
when geometric results are deduced as simple corollaries of general 
algebraic theorems, such as the Cartesian classification of second 
order lines and surfaces. 

Redesigning of the course of lectures also resulted in a consider¬ 
able reordering of seminar classes. It turned out, moreover, that the 
existing problem books in linear algebra by D. Faddeev and I. Somin- 
sky, Problems in Higher Algebra, Mir Publishers, 1972 and by 
I. Proskuryakov, Problems in Linear Algebra, Mir Publishers, 1978 
could only be used to a very limited extent. Both of the above- 
mentioned books assume that when solving problems on linear and 
Euclidean spaces the student is already acquainted with matrix 
algebra and systems of linear equations. This, as shown above, is 
not always true in our case; besides, problems were required on the 
nontraditional topics of the course. All this stipulated the necessity 
of a new problem book to accompany V. Voyevodin’s course, and 
this book is now offered to the reader. 

The present book closely follows the structure of the hook by 
V. Voyevodin with some insignificant deviations demanded by the 
particulars of the course of study. Thus, since the corresponding 
topic of the course of lectures is studied at the very end of the first 
term, seminar classes cannot keep up with the course and so the 
section devoted to metric spaces is included in Chapter 8. 

The sequence of topics chosen in Voyevodin’s course creates cer- 
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tain difficulties for the author of the problem book. For example, 
how can the computational problems of the first two chapters be 
solved when matrices and the greater part of the results derived by 
the theory of systems of linear equations cannot be used? It happens, 
however, that for the solution of typical computational problems on 
linear and Euclidean spaces, it is sufficient to combine elementary 
transformations of vector spaces with the method of Gauss elimina¬ 
tion and thus a method to check consistency and definiteness and a 
technique for finding any solution of a system of linear equations 
are obtained (see the particulars in Secs. 1.0 and 2.0). Accordingly, 
Gaussian elimination is described in Voyevodin’s book in Chapter 2: 
just when it is required for the seminar classes. Problems involving 
all the solutions of a system of linear equations are given in the 
problem book only from Chapter 4 on. Note that we are guided here 
by the same principles as A. Kurosh in Higher Algebra, Mir Pub¬ 
lishers, 1980. He starts with the description of the method of succes¬ 
sive eliminations of unknowns. 

The reader will note that the first six chapters of the problem book 
and some sections of Chapter 7 are devoted to customary topics. But 
here too, because of the specific character of the CMC, the author 
has striven to underline the computational aspects of the topics 
under consideration. Consequently, a great deal of attention is paid 
to the considerable number of questions that arise in practical 
computations using the Gauss method. Therefore, in some cases 
computational algorithms effectively employed in practice have 
been formulated as a series of problems. 

A number of sections in the last two chapters correspond to the 
new topics in Voyevodin's course and for the first time are included 
in a problem book on linear algebra. 

It is a basic requirement that any problem book should contain 
a sufficient number of useful and comprehensive problems for seminar 
classes, home-assignments, tests and examinations. The author 
hopes that this requirement has been fulfilled. Moreover, he has 
attempted to supply the strongest students with a material for 
personal study, and to lead them to problems currently faced in 
computational algebra. Thus, he has included Wilkinson’s hypothe¬ 
sis regarding the rate of growth of the elements in the Gauss method 
(Sec. 3.4), the description of the Strassen algorithm for the economical 
multiplication of matrices (5.4), the results obtained by Wilkinson 
regarding ill-conditioned eigenvalues (Sec. 8.4), and so on. 

And now some notes on the use of this problem book. 

The number of each problem in a section consists of three parts, 
the first indicating the chapter number, the second the section 
number, and the third the number of the problem. Formulae that 
may be referred to afterwards are enumerated similarly but sepa¬ 
rately. 
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For the reader’s convenience each chapter is preceded by a “zero” 
section defining the concepts and, in some cases, methods used in 
that chapter. A number of terms are, however, also defined in the 
problems themselves. To make it easier for the reader to find “the 
origin” of some term or other there is an index at the end of the book. 

The asterisks marking some of the problems should be treated as 
the “Attention” sign. In case of a problem requiring proof this means 
that it either states an important fact (irrespective of the complexity 
of the proof) or requires some nonstereotyped reasoning. A problem 
requiring computation marked by the asterisk allows for a non¬ 
stereotyped solution based, typically, on a theoretical statement. 
Many problems marked by asterisks are supplied with either hints- 
or complete solutions. Anyway, the key to the solutions of all the 
problems may be found either in this problem book or in Voyevodin’s 
textbook. Hints or solutions are also given for many problems 
having no asterisk so as to demonstrate what is, from the author’s 
point of view, the most rational approach to such problems. In ad¬ 
dition, problems are, as a rule, grouped logically, the asterisked 
one being “the leader" in a group and the others being simple corol¬ 
laries to it. The position of a problem, therefore, also contains some 
information about it. - 

Whilst compiling this problem book the author resorted to many 
sources and it is unfortunately impossible to mention them all here. 
The author’s task was simplified to a very great extent by the avail¬ 
ability of a number of excellent textbooks in linear algebra by Soviet 
mathematicians and, in particular, by the problem books that have 
already been mentioned. In some cases statements borrowed from 
the current, specialised literature were formulated as problems. 

The initiative in writing this book was taken by Prof. V. Voyevodin 
and Prof. I. Berezin. The author is glad to have the chance to express 
his profound gratitude to them. He considers it his pleasant duty 
to also record his gratitude to the higher algebra lecturers in the 
CMC department for their valuable assistance. 


H. Ikramov 



CHAPTER 


Linear Spaces 


1.0. Terminology and General Notes 

A set V is called a linear space over a number 

field, P if: 

A. For the elements of this set, the operation of addition is defined 
so that V is a commutative (Abelian) group. This means that the 
following conditions are fulfilled: 

(i) The operation of addition is commutative, i.e. 

x -f y = y + x. 

(ii) The operation of addition is associative, i.e. 

(x + y) + z = x + (y + z). 

(iii) There exists in V the (unique) null element 0 satisfying, for 
every element x of V, the equality 

x + 0 = x. ■ 

(iv) For each element x from V there is a unique inverse element 
—x such that x -r (— x) = 0. 

B. The operation of multiplication by a number from P is defined 
on the elements of the set V so that for any elements x and y from V, 
and for any numbers a and (3 from P the following conditions are 
satisfied: 

(i) a (x + y) = ax + ay. 

(ii) (a T P) x = ax -f px. 

(iii) (ap) x = a (px). 

(iv) 1 • x = x. 

The elements of a linear space are said to be vectors, and the linear 
space itself is also called a vector space. 

If P is the field of real or complex numbers, then the linear space 
over P is said to be real or complex, respectively. 

In this book, with the exception of some problems in Chapter 1, 
only real and complex linear spaces are considered. 

In a particular case, the space V may contain only one element 
(see Problem 1.1.1). Such a linear space is said to be the null (or 
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trivial) space and is denoted hereafter by 0. All other real or complex 
spaces contain infinitely many elements. 

The vector y = a 1 x 1 + a 8 x 2 + . . . + o. h x h is said to be a- linear 
combination of vectors x,, x 2 , . . x h or to be linearly expressed in 
terms of these vectors. The set of all linear combinations of a fixed 
set of vectors x lf . . ., x k is called the span of this system and is 
denoted by L (Xj, . . ., x h ). 

The set of vectors i lt . . ., x h is said to be linearly dependent if 
at least one of the vectors x t can be linearly expressed in terms of 
the other vectors of the set, and linearly independent if otherwise. 
This definition is equivalent to the following: a set of vectors Xj, . . . 

. . ., x h is linearly dependent if there exist the numbers a x .a fc , 

at least one of them being different from zero, such that 

<* 1*1 + . . . + <x h x k = 0, 

and linearly independent if the indicated equality holds only in the 
case when all a t are zeroes. 

In particular, the linear dependence of a set of two vectors x, y 
means that either y = ax or x = |Jy. In this case the vectors x 
and y are known as collinear. 

The following basic theorem about linear dependence is true: if 
each of the vectors of a linearly independent set y u . . ., y t is linearly 
expressed in terms of the set x x , . . ., x h , then l ^ k. 

A linearly independent set of vectors e v . . ., e„ in whose terms 
any vector of a space V can be expressed is called a basis for this 
space. The linear space is said to be finite-dimensional if it has a basis 
and infinite-dimensional if otherwise. 

Beginning with Sec. 1.4, we shall consider only finite-dimensional 
linear spaces. 

All bases for a finite-dimensional space V contain the same number 
n of vectors. The number n is called the dimension of the space V 
and is denoted by dim V. Moreover, V itself is then called an n-di- 
mensional space. By definition, dim 0 = 0. 

The coefficients o^, . . ., a„ in the decomposition of a vector x 
in terms of the vectors in a basis e lt . . ., e n , i.e. in 

x = a,*! + . . . + a n e n , 

are called the coordinates of the vector x. 

Two linear spaces over the same field are said to be isomorphic if 
there is a one-to-one correspondence between their vectors such that 
the image of the sum of two vectors is the sum of their images, and 
the image of the product of a vector by a number is the product of 
the image of this vector by the same number. The necessary and 
sufficient condition for isomorphic correspondence between two 
linear spaces is coincidence of their dimensions. 
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A subset L of a linear space V is called a linear subspace of this 
space if it is also a linear space under the operations introduced on V. 

If L x and L t are linear subspaces of a space V then the set of vectors 
belonging both to L x and L s is called the intersection of the subspaces 
L x and L 2 , and is denoted by L x L 2 . The set of all the sums x 2 + x 2 , 
where x 2 £ and x 2 6 L t , is called the sum of the subspaces L 2 and 
L 2 . We denote the sum of the subspaces by L x + L t . If for each 
vector x from L = L 2 + L 2 , the representation 

x = x 2 + x t , 

where x 2 £ L v x 2 g L t , is unique, then L is called the direct sum 
of the subspaces L x and L 2 , and is denoted by L 2 + L 2 . 

Most of the computational problems in this book are formulated 
for two particular linear spaces. Let us describe them in more detail. 

1. The n-dimensional arithmetic space. The elements of this space 
are ordered sets of n numbers, whether real or complex, and are 
called n-dimensional vectors. Respectively, we shall speak of the 
real or complex arithmetic space, and denote them by R n and C„. 
If the n-dimensional vectors are written in the form 

x = (<*!, a 2 , . . a„), y = (p x , p 2 .p„) 

then the operations over them are defined by the equalities 

x + y = (cti + p 1( a t + p 2 .o„ + P„), 

Xx = (Xa x , Xa 2 , . . ., Xa„). 

Of the bases of the arithmetic space, one is placed in a favoured 
position by the very nature of this space. This basis, formed by the 
unit vectors 

e 2 = (1, 0, 0, . . 0), 

«* = ( 0 , 1 , 0 , . . ., 0 ), 

. (1-0.1) 

= (0, 0, 0, . . 1), 

is called the standard basis for the arithmetic space. The “favour” 
is the absence of necessity to calculate the coordinates of a vector 
x = (<*!, a 2 , . . ., a„) in this basis since they are the numbers 
a 1( a 2 .a n . 

2. The space of polynomials of degree ^ n. A polynomial of 
degree k 


1 (0 = a 0 + a 2 t + a 2 t 2 + . . . + a h t h , a h ^= 0 


( 1 . 0 . 2 ) 
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is an object fully determined by the ordered set of coefficients 
a 0 , a 2 , . . a h . The equality of two polynomials is the equality of 
corresponding coefficients. Meanwhile, the coefficients of the poly¬ 
nomial may be real or complex numbers. In the problems, as a rule, 
only the first case is considered. The space of polynomials of degree 
with real coefficients is denoted in this book by M„. Real or 
complex numbers themselves are regarded to be polynomials of 
zero degree, except the number zero whose degree is not defined. 
This number serves as the null element in the polynomial space. 
The operations over polynomials are reduced to the same operations 
carried over their coefficients. 

A polynomial (1.0.2) may be regarded as a function of a real or 
complex variable t. The definition of equality of two functions, how¬ 
ever, differs from the “algebraic" definition of the equality of poly¬ 
nomials. Namely, functions are considered to be equal if their values 
are equal for all the values of the variable. Certainly, polynomials, 
equal in the sense of “algebraic” definition, are also equal as the 
functions of t, but the converse i9 established only at the end of 
Chapter 4. Therefore the notation / (c) should be interpreted as a 
short form of writing the number a 0 + a 2 c + a 2 c 2 + . . . + a h c k ; 
the equality / (c) = d as a short-hand way of writing the condition 
imposed on the coefficients of the polynomials considered; / (— t) 
as a contracted designation of the polynomial a 0 — a 2 t + a 2 t 2 -r . . . 
. . . + (—l)* a h t k ; and the equality / (t) = f (—t) as the short-hand 
for the conditions a 2 = 0, a 3 = 0, . . ., etc. 

The following computational problems, stated for the arithmetical 
space, are typical of the present chapter. 

1. Determine whether the given set of vectors is linearly dependent 
or linearly independent. 

2. Find the maximum number of linearly independent vectors 
contained in a given set, i.e. its rank. 

3. Determine whether a vector x is expressed in terms of the set 
of vectors j/ lt . . ., y h in which case calculate the coefficients of this 
decomposition, i.e. 

x = any x + . . . + a h y h . 

To solve Problems 1 and 2, “the method of elementary transfor¬ 
mations” (see 1.2.17, 1.2.18) is developed. The idea of the method 
is to reduce a given set without changing the rank to a set of vectors 
whose linear independence or rank is self-evident. 

Problem 3 reduces to the solution of a system of linear equations 
for which the Gauss method or the method of successive elimination of 
unknowns is performed. The idea of the method lies in transforming 
the system to its simplest form without affecting the solution set of 
the system. Let us describe the Gauss method in more detail bearing 
in mind also its numerous applications in the subsequent chapters. 
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Let a system of linear equations be given: 


a^Xj + <^2**2 + ®\s**3 + • 

+aft>x n = b< 1 °\ 


ck\x x + a[Vx 2 + a$x 3 + . 

..4^x n = 6f, 

(1.0.3) 

a 3 °\X , + afyx 2 + a^Xj + . 

..+4°„ ) X n = b ( 3 0) , 

a«lxi + a«lx 2 + d<&x 3 +. 




Assume that a*®* 0. This can always be achieved if there are some 

a)?’ among the coefficients different from zero, and reordering, if 
necessary, the equations of the system and/or changing the enumer¬ 
ation of the unknowns. Now, subtract both sides of the first equation, 
premultiplied by /atf) from the corresponding sides of the second, 
then subtract both sides of the first equation, premultiplied by 
/aff, from the third equation, etc. We obtain, in the end, a sys¬ 
tem in the following form: 


a\W -f- ai 2 :r 2 4- aiVxj -)- .. 


j + C^Xj + . . 

<& 2**2 + ® 33**3 + ■ ■ 


T ® ( ln*n = ^l l >» 
- L a^ ) x n = 6^ 1) , 

^aWx n = b ( 3 '\ 


®m2*2 + ®m3*S + • 


Here a'iV = afj, j = 1, . . ., n\ bT= b'®*; all the other elements 
are altered according to the formulae 


W ®fi\ &« (,) = M 0) - ^ C 


(1.0.4) 


i , j > 2. The first stage of the Gauss method has now been com¬ 
pleted. The coefficient a'u is called the pivot of the first stage. 

Assume now that, among the coefficients a\)\ i, j ^ 2, there are 
some different from zero and, in particular, =^= 0. Subtract both 
sides of the second equation, premultiplied by 

’ 4 ?. 4 ¥ ’ 


respectively, from both sides of the third and subsequent equations. 
We then obtain the following system: 

... -«*>. 

+4?*, +... + 4» *. - 4 !> . 


■ 3 *,+ ...+ 42 *.- 4 ?. 
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The coefficient a 22 is called the pivot of the second stage. . 

Continuing the process we shall finally reduce the system of equa¬ 
tions to the form: 

«iT i) x i +a%2 i) x 2 +.. . •••-(■ ain _1) a:„=M r_1) ' 

a&"x 2+ . • .+^;L>,« r _ 1 +«g- 1 > *e+ .. .+at~ i) x n =bi'~ i \ 

a^-i^- 1 +4 r --,!U+. • - +a£.V 1 U-4fci l) . 

a%-»x r +...+a%- i 'z n =b?-'\ 
0** r + ... +0-x„ 

0*x r -l- ... +0-x„ =b„~ l) ‘ 

(1.0.5) 

Here oVf”# 0, a$2~ ,> **0.4-V.V-i ^0, a' r r _1) =^0. 

If some of the numbers 6r+i* > , . . ., &m _1) are different from zero, 
then system (1.0.5) evidently has no solution, and is termed incon¬ 
sistent. Therefore the equivalent system (1.0.3) is also inconsistent. 
The inconsistency of the system could have been found out before if, 
after some stage of the elimination, or even in the original system, 
there was an equation 

0-Xj + 0"X 4 + . . . + 0*x n = 6, b =?£ 0. 

It goes without saying that having obtained such an equation we 
stop the process. 

If br+i 0 = • . . = bm -,) = 0 then system (1.0.5) is consistent. 
To find its solutions it suffices to consider the first r equations. In 
case r = n these n equations produce a system in a triangular form 

air ,, *i+aft- |> *k+ • ■ • + a rn‘\^,+at\=r l) - 

air "x t +...+ flfclW, + aft- 4, *n = bi n -'\ 


a%r l) x n =b<r l) . 


The solution of such a system is unique: from the last equation we 
deduce that x n is unique, substituting its value into the preceding 
equation we find that £„_! is unique, etc. A system of linear equations 
having a unique solution is said to be determinate. Thus, if system 
(1.0.3) can be reduced to a triangular form then it is determinate. 
This case is certain to take place when we find the decomposition of 
a vector in terms of the vectors in a basis for the space. 
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If r < n then the first r equations of system (1.0.5) form a system 
in a trapezoidal form having infinitely many solutions. Given arbi¬ 
trary numerical values to the free unknownsx r+1 , . . ., x n , we can find, 
in the way indicated above, the values of the unknowns x lt . . ., x r . 
By this method all the solutions for system (1.0.5), and, therefore, of 
system (1.0.3), can be found. A system of linear equations having 
infinitely many solutions is called indeterminate. Thus, the trapezoidal 
form of the final system in the Gauss method reveals the indetermi¬ 
nacy of the original system (1.0.3). Such is the case, for example, 
when we seek the expression of a vector x in terms of a linearly depen¬ 
dent system y l , «/ 2 , . . ., «/* on condition that x belongs to L (y x , . . .,{/(,). 

Note, in conclusion, that all transformations in the Gauss method 
may be performed with the elements of the augmented matrix made 
up of the coefficients of system (1.0.3): 



«l¥ 

&i 0) 

A 0 — 

<4? 4? •• 

. flffi 4 0) 





The transfer to the subsequent matrices A x , • • •, A r .j is performed 
by the formulae of the type (1.0.4). The method of elementary trans¬ 
formations, suggested for the solution of Problems 1 and 2, is actually 
the method of Gauss elimination used for the matrix made up of the 
vectors of the given system. 

1.1. Definition of Linear Space 

In this section a number of examples of linear spaces, and also of certain 
sets which are not linear spaces, are given. We also touch upon (see Problems 
1.1.17, 1.1.18) the axioms of a linear space. 

1.1.1. A set V 0 consists of one element 0. The operations on V 0 
are defined as follows: 

(a) 0 + 0 = 0; 

(b) A.0 = 0 for every X from the field P. Verify that V 0 is a linear 
space over the field P. 

Determine, for each of the following vector sets in a plane, whether 
this set is a linear space under ordinary vector addition and vector 
multiplication by a number. In case of the negative reply, indicate 
which particular properties of a linear space are not fulfilled. It is 
assumed that the origin of each vector is at the fixed point O of the 
plane, being the origin of a rectangular system of coordinates. 

1.1.2. All vectors whose end-points lie in the same straight line. 

1.1.3. All vectors whose end-points lie: (a) in the first quadrant 
of the system of coordinates'; (b) in the first or third quadrant; 

(c) in the first or second quadrant. 
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1.1.4. All vectors which form an angle <p, 0 ^ n, with a given 
nonzero vector a. 

1.1.5. Show that (a) the set of real numbers may be considered as 
a rational linear space; (b) the set of complex numbers may be con¬ 
sidered as a real linear space; (c) in general, any field P may be con¬ 
sidered as a linear space over a subfield P x of the field P. 

1.1.6. On the set R + of positive real numbers the following 
operations are defined: (a) “addition” x © y = xy (i.e. the ordinary 
multiplication of numbers x and y); (b) “multiplication by a real 
number” a-x = x° (i.e. raising a number to the power of a). 

Verify that the set R + , under the indicated operations is a linear 
space. 

1.1.7. Let R 2 be the set of all ordered pairs of real numbers 
x = (o lt a 2 ) under the operations: (a) if x = (a lt a 2 ) and y = 
= (Pn P2) then x + y = (04 + p x , a 2 + p 2 ); (b) for any real number 
X, Xx = (Xa lt a 2 ). 

Is R 2 a real linear space? 

1.1.8. The same question for the case with the following definition 
of the operation of multiplication by a number: if x = (a lt a 2 ) then 
Xx — (Xctj, Xa 2 ). 

1.1.9. Let P h be the set of all ordered sets of k elements from the 
field P: x = (oti, a 2 , . . ., a k ). The operations on P h are defined as 
follows: (a) if x = (a lt a 2 , . . ., a*) and y = (P,, p 2 , . . ., p ft ), then 

x + y — (a 2 + P lt a 2 + p 2 . a h + p h ); (b) for every X from 

the field P, Xx = (Xcti, Xa 2 , . . ., ka h ). Verify that P h is a linear 
space over the field P. 

1.1.10. Let Z( 2 ) be the field of two elements 0 and 1 on which the 
operations are defined by the following tables: 

(a) addition (b) multiplication 
0 1 0 1 


0 

0 

1 

0 

0 

0 

1 

1 

0 

1 

0 

1 


Construct the linear space Z{, 2> (see Problem 1.1.9). Show that for 
any vector x from Z'£\ x -j- x = 0. Find the number of vectors 
in Zjf’. 

1.1.11. Let s be the set of all infinite series of real numbers x = 
= (a lt a 2 , . . ., a„, . . .). The operations on s are defined as follows: 
(a) if x = (a,, a 2 , . . ., a„, . . .), y = (P lt p 2 , . . ., P„, . . .), then 
x + y = (aj + Pi, a 2 + p 2 , . . ., a„ + p n , . . .); (b) for any real X, 
Xx = (Xaj, Xa 2 , . . ., Xa„, . . .). 

Is $ a real linear space? 
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1.1.12. Let F be the set of all infinite series of real numbers whose 
elements satisfy the relation a h = a*-! + a fc _ 2 , k = 3, 4, . . , 
The operations over series are defined just like in Problem 1.1.11. 
Is f a linear space? 

Verify, for each of the following sets of polynomials in one variable 
and with real coefficients, whether this set is a linear space under 
the ordinary operations of addition of polynomials and multipli¬ 
cation of a polynomial by a number. 

1.1.13. The set of polynomials of any degree, with zero adjoined. 

1.1.14. The set of polynomials of degrees with zero adjoined. 

1.1.15. The set of all polynomials of a given degree n. 

1.1.16. The set of all polynomials / (t) satisfying the conditions: 
(a) / (0) = 1; (b) / (0) = 0; (c) 2/ (0) - 3/ (1) = 0; (d) / (1) + 
+ / (2) + ...+/ (k) = 0. 

1.1.17. * Give an example of a set M in which all the axioms of 
a linear space are fulfilled except the axiom: 1-x = x for every x 
from M. How important is this axiom for the definition of a linear 
space? 

1.1.18. * Prove that the commutative law follows from the other 
axioms of a linear space. 

1.2. Linear Dependence 

Besides the problems involving the notion of linear dependence, we provide, 
in the present section, the computational means for the solution of a problem ot 
linear dependence, or independence, of a concrete set of vectors in arithmetic 
space, viz., the elementary transformations for the set. 

1.2.1. Prove that a set of vectors containing the null vector is 
linearly dependent. 

1.2.2. Prove that a set of vectors two of whose vectors differ 
only by a scalar multiplier, is linearly dependent. 

1.2.3. Prove that if, in a set of vectors, some subset is linearly 
dependent, then the whole set is linearly dependent. 

1.2.4. Prove that in a linearly independent set of vectors, any 
subset is also linearly independent. 

1.2.5. Let a set of vectors x x , . . ., x m be linearly independent 
and let the set x lt x 2 , . . ., x m , y be linearly dependent. Prove that 
the vector y is linearly expressed in terms of x lt . . ., x m . 

1.2.6. Show that the decomposition of the vector y in terms of 
x lt . . ., x m (see the previous problem) is unique. 

1.2.7. Conversely, let the decomposition of the vector y in some 
set x,, . . ., x m be unique. Prove that the set x„ . . ., x m is linearly 
independent. 

1.2.8. Let a vector y be linearly expressed in terms of a linearly 
dependent set x,, . . ., x m . Show that y has infinitely many decom¬ 
positions in terms of the set. 

2* 
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1.2.9. Let x, y, z be a linearly independent set of vectors. Are 
the following sets of vectors linearly independent: 

(a) x, x + y, x + y + z; (b) x + y, y + z, z + x; 

(c) x — y, y — z, z — x? 

1.2.10. Show that for any vectors a:, y, z, and any numbers a, p, y, 
the set of vectors ax — py, yy — az, pz — yx is linearly dependent. 

1.2.11. Let r, s, v be different real numbers. Is the following set of 
polynomials linearly dependent: 

(t - r ) (t — s), ( t — r) (t — v), ( t -s) (t — u)? 

1.2.12. Find the linear combination 3x x — 2x 2 + 7x 3 of the 
vectors of the arithmetic space /? 4 : 

x x - (3, 1, -7, 41, 
x, = (1, 5, 0, 6 ), 
x s = (-1, 1, 3, 0). 

Discuss the result obtained. What can be said of the set of vectors 

®lt ®2i ^3^ 

1.2.13. Given a set of polynomials /, (0 = 1 — t 2 , / 2 (f) = 
= 1 + t 3 , /j (0 = 1 — t 3 , / 4 (0 = 1 + t + t 2 + t 3 , find the follow¬ 
ing linear combinations of the polynomials of this set: (a) bf x + / 2 — 
— 4/ 3 ; (b) /j 4- 9 / 2 — 4/ 4 . Discuss the obtained results. What can bo 
:said of the given set of polynomials? 

1.2.14. Find other decompositions of the polynomial obtained in 
Problem 1.2.13 in terms of the set / 2 ( 0 , /a ( 0 . /3 ( 0 . f\ ( 0 - 

1.2.15. Prove that the following '‘trapezoidal” set of vectors of the 
ijjace Pi, (see Problem 1.1.9) is linearly independent: 


= ( a ll> • 

• •» a lpi 

a l. P+1’ • 

■.» oc w , ocj^+p . 

■ •> «u> «i,i+i» 

..., a lft ), 


. ., 0 , 

a Z. p+l> • 

. . , a 2 q, 0Cj i?+ j, . 

.., a 2( , a 2>l+1 , 

...,a 2 0. 

1/3 = (0, .. 

.., 0 , 

0, 

., 0, a 3 , ? +i, .. 

•’ «3l> a 3, l+P 

• •a 3h ), 

Vr = (0, • 

. .. o', 

0, 

p 

p 

..,0, o r . l+1 , 

...,a rh ). 

( 1 . 2 . 1 ) 


Here a 2iP+11 a 3i , +1 , . . ., a r , (+ i are elements of the field P and differ 
from zero. At least one of the elements a lt , . . ., a lp is also nonzero. 

1.2.16. Prove that in polynomial space, each finite set consisting 
■of polynomials of various degrees and not containing zero is linearly 
independent. 

1.2.17. Prove that linear dependence or linear independence of a 
fiat of veotprs is not affected during the following transformations of 
the set, called the elementary transformations: (a) interchanging two 
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vectors of the set; (b) multiplication of a vector of the set by a non¬ 
zero number; (c) addition of one vector of the set to another mul¬ 
tiplied by an arbitrary number. 

1.2.18. Prove that an arbitrary set of vectors of the arithmetic 
space can be reduced, by the elementary transformations, to a set 
of vectors of the type indicated in Problem 1.2.15, probably, with 
some zero vectors adjoined. How can it be determined whether the 
original set was linearly dependent? 

Determine whether the following vector sets of arithmetic spaces' 
are linearly dependent: 

1.2.19. x x = (-3, 1, 5), 1.2.20. = (4, -12, 28), 

x 2 = (6, -2, 15). x 2 = (-7, 21, -49). 

1.2.21. x t = (1, 2, 3, 0), 1.2.22. x x = (1, i, 2 - i, 3 + Or 

x 2 = (2, 4, 6, 1). x 2 = (1 - i, 1 + i, 

1 - 3i, 4 - 20. 

1.2.23. x t = (1, 2, 3), 1.2.24. x, = (1, 2, 3), 

x, = (2, 5, 7), x 2 = (2, 5, 7), 

x 3 = (3, 7, 10). x 8 - (3, 7, 11). 

1.2.25. x x = (1, 2, 3), 

x 2 = (2, 5, 7), 

x s = (3, 7, 10 + e). 

Here e is however small number other than zero. 

1.2.26. x x = (1, 1, 1, 1), 1.2.27. x, = (5, -3, 2, 1, 10), 

x 2 = (1, -1, -1, 1), x 2 = (-1, 8, 1, -4, 7), 

x 3 = (1, -1, 1, -1), x s = (2, 1, 9, -3, 6), 

x 4 = (1, 1, -1, -1). x 4 = (1, 3, -5, 9, 11). 

1.2.28.* Let a set of vectors of an arithmetic space be given 
x, = (on, a 12 , .... a^), 
x 2 = (a 21 , a 22 , . . ., a 2n ), 

x« = (a.„ a, 2 , . . ., tz,„), 

where s ^ n. Prove that if | a }] \ > T] I <*u I, / = 1, . . ., «»• 
i-l ir=J 

then the given set of vectors is linearly independent. 
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1.3. Spans. Rank of Vector Sets 

In this section we offer problems involving the definitions of the span; the 
equivalence of sets of vectors; the base and rank of a vector set; and also a num¬ 
ber of computational problems for finding the rank, and constructing the base 
of a vector set in arithmetic space. The method of elementary transformations 
developed in the previous section is the way to solve the latter problems. 

Describe the spans of the following vector sets in the space R b : 

1.3.1. z x = (1, 0, 0 0. 0), 1.3.2. z x = (1, 0, 0, 0, 1), 

z 2 = ( 0 , 0 , 1 , 0 , 0 ), z 2 = ( 0 , 1 , 0 , 1 , 0 ), 

* 3 = ( 0 , 0 , 0 , 0 . 1 ). z 3 = ( 0 , 0 , 1 , 0 , 0 ). 

1.3.3. z, = (1, 0, 0, 0, -1), 
z 2 = (0, 1, 0, 0, -1), 
z 3 = (0, 0, 1, 0, -1), 
z 4 = (0, 0, 0, 1, -1). 

Find the spans of the following sets of polynomials: 

1.3.4. 1 , t, t\ 1.3.5. 1 + f*. t + (M + t + 

1.3.6. 1 - f*, t - t\ 2 - t - t*. 1.3.7. 1 - f*. t - t 2 . 

1.3.8. * Consider the span generated by numbers 1 and |/ 3 in the 
set of real numbers and treated as a rational linear space. Does 

belong to this span? 

1 .3.9. If every vector of a set y u y t ,. . ., y n is a linear combination 
of the vectors x lt . . z m , then the set y u . . ., y n is said to be linearly 
expressed in terms of the set x lt . . z m . Prove the transitive law for 
this concept, i.e. if the set y lt . . y n is linearly expressed in terms 
of the set z lt . . ., z m and the set z Jt . . ., z p is linearly expressed in 
terms of y lt . . ., y n , then the set z lt . . ., z p is linearly expressed in 
terms of x lt . . ., z m . 

1.3.10. Show that if a set y lt . . ., y n is linearly expressed in terms 
of x lt . . ., x m , then the span of the first set is contained in the span 
of the second. 

1.3.11. The set of vectors z u z t is linearly expressed in terms of 
the set y u y t , y 3 , y t : 

zi = 2«/! + y 2 + 3j/ 4i 
H = </i — %* + 4 j / 3 — 2 j/ 4 . 

Also the set y lt y z , y 3 , y t is linearly expressed in terms of the set 
Zi, x 3 , z 3 : 

yi = + *2 + x 3 , 

y 2 = z 4 + z 2 — z 3 , 

i/3 = X 1 — X 2 + X 3> 
y 4 = ~ X 1 + X 2 + X 3' 
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Find the expressions of the vectors z x , z 2 in terms of the vectors 
x i» x 2 , x 3 . 

1.3.12. Two sets of vectors x x , . . ., x m and y x , . . ., y n are said to 
be equivalent if each of these sets is linearly expressed in terms of the 
other. Prove that the equivalence relation is reflexive, symmetric 
and transitive. 

1.3.13. Show that two sets of vectors are equivalent if, and only 
if, their spans coincide. 

Are the following sets of vectors equivalent? 


1.3.14. = (1, 0, 0), y x = (0, 0, 1), 

* 2 = (0, 1 , 0 ), y 2 = (0, 1 , 1 ), 

*3 = (0, 0, 1); y 3 = (1, 1 , 1). 


1.3.15. x x = (1, 0, 0), 

x 2 = (0, 1, 0), 

*a = (0, 0, 1); 


1/1 = (1, 0, 0), 

y* = ( 0 , 1, l), 
y 3 = (l, 1, l). 


1.3.16. * Prove that two equivalent linearly independent sets 
contain the same number of vectors. 

1.3.17. In a set of vectors x x , . . ., x m , y x , . . ., y n , the vectors 
y v . . ., y n are linearly dependent on the vectors x v . . ., i m . Show 
that the set x lt . . .,x m ,y v . . ., y„ is equivalent to the set x x , . . .,x m . 

1.3.18. * Prove that in each set of vectors x lt . . ., x m containing 
at least one nonzero vector, an equivalent linearly independent 
subset may be chosen. (Any such set is called the base of the given 
set of vectors.) 

1.3.19. Prove that all the bases of a given set x x . x m consist 

of the same number of vectors. (This number is called the rank of 
the given set. If all vectors of the set are zero then its rank is zero 
by definition). 

1.3.20. Let the rank of a set x x , . . ., x m be equal to r. Prove that 
(a) any of its subsets containing more than r vectors is linearly 
dependent; (b) any linearly independent subset containing r vectors 
is a base of the given set. Note that it follows from (a) that the rank 
of a set of vectors equals the maximal number of its linearly inde¬ 
pendent vectors. 

1.3.21. Prove that (a) any nonzero vector of a given set can be 
included into a certain base of this set; (b) any linearly independent 
subset of the given set of vectors can be extended to form the base 
of this set. 

1.3.22. Prove that if a set y lt . . y n is linearly expressed in terms 
of a set £j, . . ., x m , then the rank of the first set is not greater than 
the rank of the second. 
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1.3.23. Prove that if a set y lt . . ., y n is linearly expressed in 
terms of a set x lt . . x m , then the rank of the set x lt . . x m , y lt . . . 
. . y n equals the rank of the set x 2 , . . ., x m . 

1.3.24. Prove that equivalent vector sets have the same rank. 
Determine whether the converse is true, viz. whether any two sets 
of the same rank are equivalent. 

1.3.25. * Prove that if two vector sets have the same rank and 
one of these sets is linearly expressed in terms of the other, then 
these sets are equivalent. 

1.3.26. Prove that elementary transformations of a vector set do 
not alter the rank of this set. 

1.3.27. Apply the method of “reduction to the trapezoidal form" 
worked out in Problem 1.2.18 to the solution of the following 
problem: find the rank of a given vector set of the arithmetic space. 

Find the rank of the following vector sets: 

1.3.28. xj = (1, 2, 3), 1.3.29. x 2 = (1, 4, 7, 10), 

x 2 = (4, 5, 6), x 2 = (2, 5, 8, 11), 

*3 = (7, 8 , 9), x 8 = (3, 6, 9, 12). 

x 4 = (10, 11, 12). 

1.3.30. = (1, -1, 0, 0), 1.3.31. x y = (1, -1, 0, 0), 

x 2 = (0, 1, -1, 0), x 2 = (0, 1, -1, 0), 

x 8 = (0, 0, 1, -1), x 8 = (0, 0, 1, -1), 

x 4 = (0, 0, 0, 1), x 4 = (-1, 0, 0, 1). 

Xj = (7, -3, -4, 5). 

1.3.32. x, = (1, 10, 0, 0), 1.3.33. x 2 = (1, 1, 1, 1, 1), 

x 2 = (0, 1, 10, 0), x 2 = (1, i, -1, -i, 1), 

x 3 = (0, 0, 1, 10), x 3 = (1, -1, 1, -1, 1), 

x 4 = (10, 0, 0, 1). x 4 = (1, -i, -1, i, 1). 

1.3.34. * Use the method of Problem 1.3.27 to find a base for a 
given vector set in the arithmetic space. 

Find a base for each of the following vector sets: 

1.3.35. x 2 = (-1, 4, -3, -2), 1.3.36. x 2 = (0, 2, -1), 

x 2 = (3, _7, 5, 3), x 2 = (3, 7, 1), 

x 3 = (3, -2, 1, 0), x 3 = (2, 0, 3), 

x 4 = (_4, 1, 0, 1). x 4 = (5, 1, 8). 

1.3.37.* x x = (14, -27, -49, 113), 
x 2 = (43, -82, -145, 340), 
x 3 = (-29, 55, 96, -227), 
x 4 = (85, -163, -293, 677). 
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1.3.38. x x = (3 - i, 1 - 2t, -7 + 5i, 4 + 3i), 
x 2 = (1 + 3t, 1 + t, —6 — 7i, 4i), 

z 3 = (0, 1, 1, -3). 

1.3.39. * The vectors x it , . . ., x lr of a set x lt . . x m form a base 
and the vector x Jt the nonzero vector, is not in this base. Prove that, 
among the vectors of the base, there is a vector x t[ such that on 
replacing it with xj in the subset Xi t , . . ., x lr , a new base of the given 
set x v . . ., x m is obtained. Is this vector, x l[t unique? 

1.3.40. * What can be said about a vector set of rank r if it has 
(a) a unique base; (b) precisely two bases; (c) precisely three bases? 
NB. Two bases, diSering only in the order of vectors, are treated 
as the same. 

Find all the bases of the following vectors: 

1.3.41. = (4, -2, 12, 8), 1.3.42. x 2 = (1, 2, 3, 0, -1), 

x 2 = (_6, 12, 9, -3), x 2 = (0, 1, 1, 1, 0), 

x 3 = (_10, 5, -30, -20), x 3 = (1, 3, 4, 1, -1). 

x« = (_14, 28, 21, -7). 

1.3.43. x x = (1 + i, 1 — i, 2 + 3i), 

x 2 = (i, 1, 2), 

x, = (1 — i, —1 — i, 3 — 2i), 
x t = (4, —4i, 10 + 21). 

1.3.44. * Apply the method of Problem 1.3.27 to the solution of 
the following problem: determine whether a given vector set y lt . . . 

. . ., y„ is expressed in terms of a vector set x lt . . ., x m , both being 
in the arithmetic space. 

1.3.45. Given two vector sets, 

= (1, 1, 1), Vi = (1, 2, 3), 

* 2 = (1, 0, -1), y t = (0, 1, 2), 

*3 = (1, 3, 5); y 3 = (3, 4, 5), 

y* = ( 4 . 6 . 8 ) 

determine whether the set y x , y 2 , y 3 , y t is linearly expressed in terms 
of the set x x , x 2 , x 3 . 

1.3.46. Are the sets indicated in the previous problem equivalent? 
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1.4. Basis and Dimension of Space 

We begin this section with examples of finite-dimensional and infinite¬ 
dimensional linear spaces so as to consider, hereafter, only the finite-dimensional 
spaces. Furthermore, we discuss the notion of a basis. If, in a linear space, a 
basis is fixed, then the problems involving the elements of this space are reduced 
to similar problems involving the vectors of arithmetic space. Some of these 
problems (finding the rank of a vector set, the dimension and basis of the span, 
etc.) are solved by the method of elementary transformations, others (e.g. the 
decomposition in terms of a basis) are reduced to the solution of certain systems 
(known beforehand) of linear equations, the rational way of their solution being 
the Gauss method. The section is concluded by problems involving linear sub¬ 
spaces. 

Determine, for each of the linear spaces indicated below, whether 
they are finite-dimensional. In case of the positive reply find the 
dimension and construct a basis for the space. 

1.4.1. The space R* (see Problem 1.1.5). 

1.4.2. The space whose elements are ordered sets of k elements 
of the field P (see Problem 1.1.9). 

1.4.3. The spaces of all infinite real sequences (see Problem 1.1.11). 

1.4.4. The space F of infinite real sequences whose elements satisfy 
the relationship a h = a*-! + a h . 2 , k = 3, 4, ... (see Prob¬ 
lem 1.1.12). 

1.4.5. The space M of polynomials of all degrees (see Problem 
1.1.13). 

1.4.6. The space M„ of polynomials whose degree does not exceed 
a given nonnegative number n (see Problem 1.1.14). 

1.4.7. Find the dimension of the field of complex numbers con¬ 
sidered as (a) the complex linear space; (b) the real linear space. 

1.4.8. Let C n be the set of all ordered sets of n complex numbers 
under the customarily defined operations on these sets (see Problem 
1.1.9). Find the dimension of C n as (a) a complex space; (b) a real 
space. 

Show that the following vector spaces are the bases for the space R n : 


1.4.9. Xl = (1, 2, 3, . 

. ., 71), 

1.4.10. = (1,1,. 

..,1,1,1), 

i 2 = (0, 2, 3, . 

. n). 

= (1,1, • 

..,1,1,0), 

*3 = (0, 0, 3, 

. ., 71), 

*3= (1.1- 

...1,0, 0), 

*„ = (0, 0, 0, . 

. ., 7l). 

x n = (l,0,. 

. .,0, 0, 0). 


1.4.11. Xl = (1, 1, 

1, 1, . . 

., 1), 

* 2 = (0, 1, 

0, 0, . . 

., 0), 

*3 = (0. 1, 

1, 0, . . 

0), 

*4 = (0, 1, 

1, 1, . . 

0), 

X„ = (0, 1, 

1, 1, . . 

1). 
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1.4 


1.4.12. Prove that in the space M„ of polynomials of degree 

the basis is any set of nonzero polynomials containing one poly¬ 
nomial of each degree k, k = 0 , 1 , 2 , . . ., n. 

1.4.13. Determine which of the following two vector sets is a 
basis for the space R t : 


(a) x, = ( 1 , 2 , - 1 , - 2 ), 
x 2 = (2, 3, 0, -1), 
x 3 = (1, 2, 1, 3), 
x 4 = (1, 3, — 1 , 0); 


(b) x, = (1, 2, -1, -2), 
x 2 = (2, 3, 0, -1), 
x 8 = (1, 2. 1, 4), 
x 4 = (l, 3 , _l, 0 ). 


Henceforward, only the finite-dimensional spaces will be considered. 

1.4.14. Prove that (a) any nonzero vector of a space may be includ¬ 
ed in a certain basis for this space; (b) any linearly independent 
vector set can be extended to form a basis for the space. 

1.4.15. Find two different bases for the space R t having the vectors 
Cj = ( 1 , 1 , 0 , 0 ), and e 2 = ( 0 , 0 , 1 , 1 ) in common. 

1.4.16. Extend the set of polynomials t 6 + t*, t 5 — 3t 8 , t* 4- 2f 2 , 
t b — t to form a basis for the space Af s . 

1.4.17. Prove that the decomposition of a vector in terms of vectors 
of any basis is unique. 

1.4.18. Let every vector of a space V be linearly expressed in 
terms of the vectors in a set e lt . . ., e n and let the decomposition of 
a certain vector x in terms of this set be unique. Prove that the 
vectors e v . . ., e„ form a basis for the space V. 

1.4.19. Let e lt . . ., e„ be an arbitrary basis for a space V. Prove 
that (a) the coordinates of the vector x -f y in terms of the basis 
e v . . e„ are equal to the sums of the corresponding coordinates of 
the vectors x and y in the same basis; (b) the coordinates of a vector 
Xx in the basis e Jt . . e n equal the corresponding coordinates of 
the vector x multiplied by the number X. 

1.4.20. In a space V some basis e lt . . ., e n is fixed. Each vector x 
is matched with the row of its coordinates in this basis, i.e. 

x -*-x. = (a lt a 2 , . . ., a n ). 


Prove that (a) the linear dependence (or linear independence) of a 
vector set x, y, . . ., z induces the linear dependence (linear indepen¬ 
dence) of the set of rows x e , y t , • • ., z e considered as the elements of 
the corresponding arithmetic space; (b) the rank of a vector set 
x, y, . . ., z equals the rank of the row set x e , y„ . . z e ; (c) if a vector 
u is linearly dependent on the vectors of a set x, y, . . ., z, i.e. u = 
= Xx -f \iy -f . . . -f vz, then this is true for the rows u e , x e , y e , . . . 
. . ., z e and, that besides, u e = Xx e + \iy e + . . . 4 - vz*. 

Determine the rank and find a base for each of the following sets of 
polynomials: 
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1.4.21. 3 t 3 + 2t + 1, 4 t 3 + 3t + 2, 3f a + 2f + 3, t 2 + t + 1, 
4 *a + St + 4. 

1.4.22. t 3 + 2t 2 + 3f + 4, 2* s + 3i a + At + 5, 3t s + 4f 2 + 5f + 
+ 6, 4t s + 5 t 3 + 6* + 7. 

Verify that the vectors e lt . . ., e n form a basis for the space R„\ 
find the coordinates of the vector x in this basis: 

1.4.23. = (2, 2, -1), e 3 = (2, -1, 2), e 3 = (-1, 2, 2); * - 
= (1, 1, 1). 

1.4.24. e x = (1, 5, 3), « 2 = (2, 7, 3). e 3 = (3, 9, 4); x = (2, 1, 1). 

1.4.25. ^ = (1, 2, -1, -2), e 2 = (2, 3, 0, -1), e 3 = (1, 2, 1, 4), 

e t = (1, 3, -1, 0); x = (7, 14, -1, 2). 

1.4.26. Cj = (1, 2, 1, 1), e 2 = (2, 3, 1, 0), e 3 = (3, 1, 1, -2), 
e 4 = (4, 2, -1, —6); a: = (0, 0, 2, 7). 

1.4.27. Find the coordinates of the polynomial t 3 — t* + t 3 — 
— t* — t + 1 in each of the following bases for the space M b : 

(a) 1, t, t 2 , t 3 , t*, f»; 

(b) 1, t + 1, t 3 + 1, t 3 + 1, t* + 1, t* + 1; 

(c) 1 + t 3 , t + t 3 , t 3 + t 3 , t 3 , t* + t\ t 3 + t 3 . 

1.4.28. Verify that the sequences 

= (2, 3, 5, 8, 13, . . .), 
e 2 = (1, 2, 3, 5, 8, . . .) 

form the basis for the space F (see Problem 1.1.12); express the 
sequence 

e = (1, 1, 2, 3, 5, 8-) 

in terms of the elements of this basis. 

1.4.29. Prove that the span of an arbitrary finite vector set of 
a linear space V is its linear subspace. 

1.4.30. Let V be an n-dimensional linear space. Prove that any 
linear subspace of the space V is finite-dimensional, its dimension not 
exceeding n. 

1.4.31. Prove that if L is a linear subspace of a space V and the 
dimension of L equals the dimension of V, then L coincides with V. 

1.4.32. Prove that any subspace of an n-dimensional space V 
may be considered as the span of a certain vector set. Besides, the 
set may be chosen to contain not more than n vectors. 

1.4.33. Prove that in an n-dimensional space V, a linear subspace 
of any dimension k, 0 ^ k ^ n, may be found. 

1.4.34. Given that a linear subspace L is the span of a vector set 
x lt . . ., x h , prove that the dimension of L equals the rank of the set 
x lt . . ., x h , and that any basis for this set may serve as its basis. 

Determine the dimension of and find a basis for the linear subspaces 
spanned by the following sets of vectors of the arithmetic space: 
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1.4.35. x, = (1,2,2, -l),x 2 = (2,3,2, 5), x 3 = (-1,4, 3, -1), 
x 4 = (2, 9, 3, 5). 

1.4.36. x, = (-3, 1, 5, 3, 2), x 2 = (2, 3. 0, 1, 0), x 3 = 
= (1, 2, 3, 2, 1), x 4 = (3, -5, -1, -3, -1), x 5 = (3, 0, 1, 0, 0). 

1.4.37. Find a basis and the dimension of a linear subspace of the 
space R n if L is determined by the equation 

a 2 -f a 2 -r . . . + a„ = 0. 

1.4.38. In the space M„ of polynomials with real coefficients of 
degree the subsets of polynomials satisfying the following con¬ 
ditions are considered: (a) / ( 0 ) = 0 ; (b) / ( 1 ) = 0; (c) / (a) = 0, 
where a is any real number; (d) / (0) = / (1) — 0. Prove that each 
of the indicated subsets is a linear subspace of the space M n \ find 
the dimensions for these subspaces. 

1.4.39. Find the dimension and a basis for the span generated by 
the set of polynomials: t 8 + l 4 ,f® + 3f* — t, t 6 — 2 1* L t, t* — At* + 
+ 2 1. 

1.4.40. Let L be an m-dimensional subspace of an n-dimensional 
space V. Prove that a basis e 2 , . . ., e„ for the space V may be found 
such that its first m vectors e lt . . ., e m are in the subspace L. 

1.4.41. * Prove that for whichever m-dimensional subspace L of 
an n-diraensional space V , where m < n, there is a basis for V such 
that (a) it contains no vectors from L; (b) it contains precisely k 
vectors from L, k<m. 

1.4.42. Construct a basis for the space M b of polynomials of the 
fifth degree. 

1.4.43. Conversely, can a basis for the space Af 5 , containing no 
polynomials of the fifth degree, be found? 

1.5. Sum and Intersection 
of Subspaces 

In this section we seek: 

To present the computational methods used to find the basis for the sum and 
intersection of two linear subspaces. 

To indicate various criteria for the “directness" of the subspace sum. 

To stress that, in the general case, the decomposition of a vector in terms of 
subspaces is not unique. It is unique only in the case of a direct sum. The sub¬ 
spaces that produce, in their sum, the whole linear space serve as the gene¬ 
ralized basis for it. 

To illustrate the existence of a complementary subspace (which is not unique) 
of any subspace. 

1.5.1. Prove that the sum and intersection of two linear subspaces 
of a space V are also linear subspaces of this space. 

1.5.2. Consider the set of all linear subspaces of a given space V 
under the operation of subspace addition. 

Verify that (a) the operation is associative; (b) there is a zero 
element. Is this set a group? 
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1.5.3. Consider the set of all the linear subspaces of a given space 
V under the operation of intersection of subspaces. Show that (a) the 
operation is associative; (b) there is an identity element. Is this set 
a group? 

1.5.4. Prove for any subspaces L x and L 2 , the validity of the 
formula 

dim L x 4- dim L t = dim (L x -f- L t ) + dim ( L x f) L 2 ). 

Here and henceforth, dim L means the dimension of the linear 
space L. 

1.5.5. Prove that, for any P, 

dim (L x -f- . . . + L p ) ^ dim L x + . . . 4- dim L p . 

1.5.6. Let L x be the span of the set of vectors x x , . . x h and L 2 
the span of vectors y x , . . ., y t . Prove that any base of the set x x , . . . 
• • •> x ht yi, • ■ -i yi serves as a basis for the sum L x 4- L 2 . In particu¬ 
lar, the basis L x + L 2 may be obtained by extending a basis for 
Lx (Lx)- 

Find a basis and the dimension of the sum of the two subspaces, 
viz. L x spanned by the vectors x x , . . ., x h and L 2 by the vectors 
y x , . . ., y t . Determine the dimension of the intersection of these 
subspaces. 

1.5.7. x x = (0, 1, 1, 1), x 2 = (1, 1, 1, 2), x 3 = (-2, 0, 1, 1); 
y x = (-1, 3, 2, -1), y 2 = (1, 1, 0, -1). 

1.5.8. = (2, -5, 3, 4), x t = (1, 2, 0, -7), x 3 = (3, -6, 2, 5); 
y x - (2, 0, -4, 6), y 2 = (1, 1, 1, 1), y 3 = (3, 3, 1, 5). 

1.5.9. * Let x x , . . ., x h be a basis for a subspace L x and y x , . . ., yi 
a basis for a space L t . Further, let x x , . . ., x fc , y x , . . ., y a be a base 
of the set x x , . . ., x fe , y x , . . ., y t and the vectors y t+x , . . ., y t not in 
this base, have the following decompositions in terms of this base: 

iji = a ix x x 4- ••• 4- h x k 4- PtiJ^x 4- • • • + 

t = s + 1, . . ., 1. 

Prove that the set of vectors z x , . . ., Zj. { where 

2 i-. = -P«yi - ... - Pi 8 y, + y„ i = s + l. i, 

or, written in other way, 

2 |-a = a n x i + • • • 4- a th x h , i = s4-l, • • •, l, 
forms a basis for the intersection L x fl L 2 . 

Find the bases for the sum and intersection of the linear subspaces 
spanned by the sets x x , . . ., x fe and y x , . . ., y t , respectively: 

1.5.10. x 2 = (2, 1, 0), x 2 = (1, 2, 3), x 3 = (-5, -2, 1); y x = 
= (1, 1, 2), y 2 = (-1, 3, 0), y 3 = (2, 0, 3). 

1.5.11. x x = (l,l,l,l),x 2 = (1,1, —1, -l),x 3 = (1,-1,1,-1); 
y x = (1. -1, -1, 1). y 2 = (2, -2, 0, 0), y 3 = (3, -1, 1, 1). 
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1.5.12. x, = (1, 2, 1, 1), x 2 = (2, 3, 1, 0), x 3 = (3, 1, 1, -2); 
!/, = (0, 4, 1, 3), y 2 = (1, 0, —2, — 6 ), y 3 = (1, 0, 3, 5). 

1.5.13. Find two different decompositions of the vector x = 
= (1,0, 1) in terms of the subspaces L x and L 2 (see Problem 1.5.10). 

1.5.14. Prove that the sum L of subspaces L u . . ., L p is their 
direct sum if find only if the union of the bases for these subspaces 
produces a basis for L. 

1.5.15. Prove that the condition stated in Problem 1.5.14 is 
equivalent to the following condition: 

dim (Lj + . . . + L v ) = dim L x -f . . . + dim L p . 

1.5.16. Prove that a subspace L = L x -f . . . + L p is the direct 
sum of the subspaces L lt . . ., L p if and only if the intersection of 
each of the subspaces L t , 1 ^ i ^ p, and the sum of the remaining 
subspaces consists of the null vector only. 

1.5.17. Let a set of subspaces L x , . . L p be ordered. Verify that 
the necessary and sufficient condition stated in Problem 1.5.16 may 
be weakened, viz. the intersection of each of the subspaces L t , 2 ^ 
^ i ^ p, and the sum of the previous subspaces should consist of 
the null vector only. 

1.5.18. Prove that the sum of subspaces L lt . . ., L p is their 
direct sum if and only if any set of nonzero vectors x lt . . ., x p , all 
chosen from different subspaces } = 1 , . . ., p, is linearly inde¬ 
pendent. 

1.5.19. Prove the associative law for the direct sum of subspaces, 
viz. if Lt = Lj -f- Lt and L = L 2 -|- L 3 , then L ~~ Lt x -f* L 2 -f* L 3 . 

1.5.20. Verify that the direct sum of the linear subspaces L x and 
L t spanned by the sets of vectors Xj = (2, 3, 11, 5), x 2 = (1, 1, 5, 2), 
x 3 = (0, 1, 1, 1) and y x = (2, 1 , 3, 2), y 2 = (1, 1, 3, 4), y 3 = 

= (5, 2, 6 , 2), respectively, produces the whole space i? 4 ; find the 
decomposition of the vector x = (2, 0, 0, 3) in terms of these sub¬ 
spaces. 

1.5.21. Prove that in the space M„ of polynomials of degree 
(a) the set L x of the even polynomials / ( t) (i.e. / (— t) = / (t)) 

and the set L 2 of the odd polynomials (i.e. / (—t) = —/ (t)) are 
linear subspaces; (b) the following equality is valid 

M„ = L x + L t . 

1.5.22. Prove that, for any subspacc L x of a linear space V, 
there is a complementary subspace, i.e. a subspace L 2 such that 

V = L, + L 2 . 

Is the complementary subspace of a given subspace L x unique? 

1.5.23. Find two different complementary subspaces of the sub¬ 
space L generated by vectors x 2 = (1, 3, 0, —1), x 2 = (2, 5, 1, 2), 
■c 3 = (1, 2, 1, 3). 
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1.5.24. In the space M„ of polynomials of degree find a com¬ 
plementary subspace to the space L of the polynomials satisfying the 
condition / (1) = 0. 

1.5.25. A space V is decomposed into the direct sum of subspaces 
L x , . . ., L p . Prove that (a) if a vector x is decomposed as follows: 

x = x x + . . . + Xp, x t 6 Z/i, 

then the decomposition of the vector Xx, in terms of the subspaces 
L 1% . . Lp , is of the form 

Xx — Xxi -I - ... -j- Xxp\ 

(b) if y is a vector with the decomposition + . . . — y P , ])t G L t , 
then the decomposition of the vector x + y, in terms of the subspaces 
. . ., Lp, is of the form 

x + y = (*i + Vi) + . • • + {x v -i- y P ). 



CHAPTER 2 


Euclidean and Unitary Spaces 


2.0. Terminology and General Notes 

A real linear space E is said to be a Euclidean 
space if for each pair of vectors x, y from E there is a corresponding 
real number designated by the symbol ( x , y) and called the scalar 
product of the vectors x and y; at that the following conditions are 
fulfilled: 


( 1 ) (x, y) = (y, x). 

( 2 ) (x + y, z) = (x, z) + (y, z). 

(3) (ax, y) = a (x, y). 

(4) (x, x) > 0 if x * 0. 

Here x, y, z are arbitrary vectors from E and a is an arbitrary real 
number. 

A (nonnegative) number is called the length of a vector x if 

|x|=/(*, *)• 

A vector whose length equals unity is said to be normalized. 

For any two vectors x and y, the Cauchy-Buniakowsky inequality 
holds: 

l(*. y) |< |x |-|y |. 

Vectors x and y are called orthogonal if their scalar product equals 
zero. A set of vectors is called orthogonal if each pair of the vectors 
in this set is orthogonal. 

Given a linearly independent set of vectors x lt x 2 , . . ., x A , let us 
describe an orthogonalization procedure that will permit this set to be 
transformed to an orthogonal set of nonzero vectors y L , y 2 , . . ., y h . 

Set yj = x L ; the subsequent vectors y 2 , . . y h are then constructed 
by the following formulae: 

Vi — X i— jEai'W 2 = 2, k. 


(i) = to. y-:) 

‘ (i/i. J/i) 


t = l.2-1. 


A basis for a Euclidean space Is called orthogonal if it is an ortho¬ 
gonal set. If the vectors of this set are normalized then this basis is 


3-oeie 
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called orthonormal. Thus, an orthonormal basis e t , 
by the relations 

f 1 if i = h 
(«'•«/>-1 0 if i=£j. 


. ., e n is specified 


For two nonzero vectors x and y of a Euclidean space, the concept 
of an angle may also be considered, its cosine being determined by 
the formula 




cos (x, y) = 


(X, y) 

I * I I y I ‘ 


A complex linear space V is called unitary space if, for each pair 
of vectors x, y from U, there is a corresponding complex number 
denoted by (x, y), called the scalar product of the vectors x and y, 
provided that the following conditions are true: 


(i) (z, y) = 0/. z). 


(2) (x + y, z) = (x, z) + (y, z). 


(3) (ox, y) = a (x, y). 

(4) (x, x) > 0 if x 0. 

In a unitary space an angle between vectors is not defined. How¬ 
ever, all the above-mentioned definitions and results regarding a 
Euclidean space also remain valid for a unitary space. 

A typical example of a Euclidean space is the arithmetical space 
R n in which the scalar product of vectors x = (a x , a 2 , . . ., a„) 
and y = (P lf |J 2 , . . ., fl n ) is determined by the rule 

(x, y) = OjPj + a 2 p 2 + . . . + a B p„. ( 2 . 0 . 1 ) 

Similarly, a typical example of a unitary space is the space C„ in 
which, for vectors x and y, 

(z, y) = a,(J, + a 2 P 2 + .». + a n (J„. ( 2 . 0 . 2 ) 

In both cases the standard basis for the arithmetical space turns out 
to be orthonormal. 

Let us make some other notes concerning the computational prob¬ 
lems of the present chapter. 

Suppose it is required to extend an orthogonal set a lt . . ., a h 
of nonzero vectors of an arithmetic space to form an orthogonal basis 
for this space. We shall look for a vector a ft+1 using the conditions 
for the orthogonality 

(a h+1 , a,) = 0 , 


(afc+i. <y = o. 
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Defined by relations (2.0.1) and (2.0.2), these conditions determine 
a system of linear equations involving the components of the vector 
a fc+1 . An arbitrary nonzero solution of this system may be chosen to 
yield a h+1 . Now, the vector a h+2 may be determined by the relations 

' («ft+ 2 » «i) = 0 . 

(a h+2 ,a h ) = 0 , 

(a fc+2 , a h+i ) = 0, 

and so on. At each stage of this extension procedure the results of the 
previous computations can be used and the solution of the linear 
equation systems found by the Gauss elimination method. 

The problem of constructing a basis for an orthogonal complement 
(see Problem 2.3.2) to the span of a given vector set in an arithmetic 
space is solved in a similar way. Gaussian elimination can also be 
applied both to the problems on computation of the vector pro¬ 
jections on a given span and to those concerning the construction of 
bases biorthogonal to the given (see Problems 2.3.10 and 2.3.15). 

2.1. Definition of Euclidean Space 

In the present section we have set ourselves the following principal goals: 

To draw the simplest corollaries from the axioms of the scalar product. 

To show that the scalar product may be defined for any real linear space, 
and in infinitely many ways. Speaking of arithmetic spaces /?„, we demonstrate 
the concrete techniques that transform the spaces into Euclidean spaces. 

To draw the reader’s attention to the fact that not only is any subspace of 
a Euclidean space itself. Euclidean, but, conversely, the scalar product, defined 
for an arbitrary subspace of a linear space is “extensible” to the whole space. 

And, finally, we intend to illustrate the significance of the axiom concerning 
the positiveness of the scalar product. 

2.1.1. Prove that it follows from the axioms for the scalar product 
that (a) ( x , y 2 + y 2 ) = ( x , y 2 ) -f ( x , y 2 ) for any vectors of a Euclidean 
space; (b) (at, ay) = a ( x , y) for any vectors x, y of a Euclidean space 
and real number a; 

(c) (x 2 — x 2 , y) = (*i, y) - (x 2 , y); 

(d) ( 0 , x) = 0 ; 

a i hi 

(e) (£ a,x„ J] P jXj ) a f P, ( x„ y ,). 

2.1.2. Prove that the scalar product may be defined for any real 
linear space. 

2.1.3. Define the scalar product for the n-dimensional arithmetic 
space R n . 

2.1.4. Define the scalar product for the space M n of polynomials- 
of degree with real coefficients. 
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2.1.5. Let V be a Euclidean space with the scalar product (x, y). 
Show that if we set 

(x, y) = X (x , y), 

where X is a fixed positive number, then, for (x, y), all the axioms 
of the scalar product are fulfilled. What is the geometric meaning of 
the transfer from (x, y) to ($, y) in the three-dimensional space of 
geometric vectors? 

2.1.6. Prove that if (x, y) 2 and (x, y) 2 are two different scalar pro¬ 
ducts on the same linear space V, then the following are also the 
scalar products 

(a) ( x, y) = (x, y) 2 + (x, y) 2 ; 

(b) (x, y) = X (x, y) 2 + p (*, y) 2 , 

where X and p are arbitrary nonnegative numbers that are not simul¬ 
taneously equal to zero. 

2.1.7. Let x = (a v a 2 ) and y = (P 2 , p 2 ) be arbitrary vectors of 
the arithmetic space R 2 . Show that the scalar product on R 2 may be 
defined in the following ways: 

(a) (x, y) = Oip! + <x 2 p 2 ; 

(b) (x, y) = 2a x Pi + 5a 2 p 2 ; 

(c) (x, y) = a x Pj + ajPj + a 2 p x + 2a 2 p 2 . 

Evaluate the scalar product of the vectors x = (1, 1) and y = 
= (,—3, 2) by each of the above rules. 

2.1.8. * Prove that the scalar product on R 2 may be defined by the 
formula 

(x, y) = aOiPj + 6a x p 2 + f>a 2 p 1 + ca 2 p 2 
if and only if a > 0 and ac > 5* simultaneously. 

2.1.9. * Prove that the scalar product on R 3 may be defined in the 
following way: if x = (a lt a 2 , a 3 ) and y = (P lt p 2 , p 3 ), then 

(*i y ) = lOcttPi + 3a i p 2 + 3a 2 p t + 2a 2 p 2 + a 2 p 3 +.a 3 P 2 + a 3 p 3 . 

2.1.10. * Prove that the scalar product on R„ may be defined by 
the formula 

(x, y) = fln^p, -(- a 12 a,p 2 + ... -f- a ln aiP„ 

+ a 21 a 2Pl + a 22 a 7^2 + • • • +®2n®2Pn 

+ a nlO n Pl+ a n2 a nP 2 + • • • + a nn®nPn 

on condition that 
(a) a„ = a, ( if i=£ j ; 

<b) a„> \a t , | t i =1, ...,n. 
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2.1.11. Let a be a fixed vector of a Euclidean space V and a a 
fixed real number. Is the set of all vectors x, for which ( x , a) = <x, 
a linear subspace of the space V? 

2.1.12. Prove that each subspace of a Euclidean space V is also 
Euclidean in the sense of the scalar product defined for V. 

2.1.13. A linear space V is resolved into the direct sum of sub¬ 
spaces L lt . . ., L p . For each of the subspaces L, the scalar product 
is defined. Prove that the scalar product may be defined for the whole 
space V, assuming that: if x and y are two arbitrary vectors from V, 
with decompositions in terms of the subspaces L lt . . ., L p respectively 
x = x t + . . . + x p and y = + . . . + y p , then 

(x, y) = (je„ yi ), + . . . + (x p , y p ) p , 
where the scalar product (x t , y t ) t is found by the rule given for L,. 

2.1.14. In the arithmetic space /? 4 the scalar product of two 
vectors of the form x = (otj, <x 2 , 0 , 0 ) and y = (P lt p 2 , 0 , 0 ) is defined 
as follows: 

(*• y)i = a iPi + 2a 2 p2< 
and that of the vectors x and y of the form 

x = ( 0 , 0 , a 8 , a 4 ) and y = ( 0 , 0 , P 3> p 4 ) 
is specified by another rule 

(*» y)t = a ap3 + a aP« + a «P 3 + 2a 4 p 4 . 

Define the scalar product for the whole space f ? 4 (by the method 
indicated in Problem 2.1.13). Compute the scalar product of the 
vectors x = (1, 2, 3, 4) and y = (—3,1, —3, 2) by the rule obtained. 

2.1.15. * The scalar product (x, y) is defined for a subspace L 
of a linear space V. Prove that the scalar product may be defined 
for the whole space V so as to be identical with the original scalar 
product (x, y) of the vectors x and y from L. 

2.1.16. * Prove that in the Cauchy-Buniakowski inequality for 
vectors x and y of Euclidean space, viz. 

(*. y? < {x, x) (y, y), 

the equality sign is upheld if and only if the vectors x and y are 
linearly dependent. 

2.1.17. Prove the following by the Cauchy-Buniakowski in¬ 
equality: 

(*) (SPi); 

1=1 i=l i=! 
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where a lt . . a n and p lt . . p n are arbitrary real numbers and 
Xj, . . X„ are positive numbers. 

2.1.18.* Given a space V for which the “scalar product” is defined 
with the fourth axiom replaced by a weaker requirement, viz. (x, x)^ 
0 for any vector x, prove that (a) the Cauchy-Buniakowski in¬ 
equality is valid; (b) the set M of vectors, such that (x, x) = 0, forms 
a subspace; (c) for any vector x from M and any vector y from V 
the scalar product equals zero; (d) if N is an arbitrary, complementary 
subspace of M, and 


x — x m + x N , y — y M + y N 

are the decompositions of the vectors x and y in terms of the subspaces 
M and N, then the equality sign in the Cauchy-Buniakowski rela¬ 
tionship for the vectors x and y is valid if and only if x N and y s 
are linearly dependent. 

2.1.19. Will the Cauchy-Buniakowski inequality be upheld if 
the fourth axiom in the definition of the scalar product is discarded? 

2.2. Orthogonality, Orthonormal Basis, 
Orthogonalization Procedure 

The problems of the present section concern the following two principal 
topics: 

The orthogonalization procedure, its applications to the construction of an 
orthogonal basis for a space and to the determination of the linear dependence 
of a given vector set. 

The orthonormal bases of a Euclidean space and their significance ^evaluat¬ 
ing the scalar product. We also intend to show the dependence of the orthonor¬ 
mality property of a basis on the method of defining the scalar product for a 
given linear space. 

2.2.1. Prove that in a Euclidean space E (a) the null vector is 
the only one possessing the property of orthogonality for all vectors 
of the space; (b) if the equality (a, x) = (6, x) is valid for any vector 
x from E, then a = b. 

2.2.2. Prove that if x, y, . . ., z is an orthogonal set of vectors, 
then, for any numbers X, p, . . ., v, the set of vectors Xx, py, . . ., vz 
is also orthogonal. 

2.2.3. Prove that if a vector x is orthogonal to each of the vectors 
y lt • ■ ., yi, then it is also orthogonal to any linear combination of 
these vectors. 

2.2.4. Prove that an orthogonal set of nonzero vectors is linearly 
dependent. 

We shall assume, hereafter, that the scalar product of the vectors 
x = (<*!, a 2 , . . ., a„) and y = (P lt P 2 , . . ., p„) belonging to an 
arithmetic space R„ is determined by the formula 

(x, y) = -f a 2 p 2 + . . . + a„Pn- 


(2.2.1) 
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Apply the procedure of orthogonalization to the following sets of 
vectors in the space R n : 


2.2.5. 


*1 = (1. -2, 2), 

* 2 = (-1. 0, -1), 
x 3 = (5, -3, -7). 


2 .2.6. x x = (1, 1, 1, 1), 

x 2 = (3, 3, -1, -1), 

x 3 = (-2, 0, 6, 8). 


2.2.7. * Prove that the orthogonalization procedure applied to a 
linearly independent set of vectors x lt . . x k leads to an orthogonal 
set of nonzero vectors y v . . ., y h . 

2.2.8. Prove that in any Euclidean space there exists (a) an 
orthogonal basis; (b) an orthonormal basis. 

2.2.9. Prove that (a) any nonzero vector may be included in some 
orthogonal basis for a Euclidean space; (b) any orthogonal set of 
nonzero vectors may be extended to form an orthogonal basis for 
the space. 

Verify that the following sets of vectors are orthogonal. Extend 
them to form orthogonal bases. 

2.2.10. x x = (1, -2, 1, 3), 2.2.11. x 2 = (1, -1, 1, -3), 

x 2 = (2, 1, -3, 1). x a = (-4, 1, 5, 0). 

Extend the following sets of vectors to form orthonormal bases: 


2 .2.12. x, = ( —i, 


_ 2 _ 
15» 
14 


2.2.13. Xj = 


4 )- 


2.2.14. Prove that the scalar product of any two vectors x and y 
of a Euclidean space is expressed in terms of their coordinates in 
certain bases by the formula 

(x, y) = a x p x + • • • + a„p n , 

if and only if these bases are orthonormal. 

2.2.15. Prove that the coordinates eij. a, of a vector x in 

an orthonormal basis e v . . e n are found by the formulae 

a, = (x, e t ), i = 1, .... n. 

2.2.16. Find the dimension of the subspace formed by all vectors x 
such that (a, x) = 0. Here a is a fixed nonzero vector of a Euclidean 
space. 
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2.2.17. * Let e lt . . ., e„ be an orthonormal basis for a Euclidean 

space. Find an expression for the scalar product of two arbitrary 
vectors x and y in terms of their coordinates in: (a) the basis ^e lt 
X 2 e 2 , . . where X lt ft 2 , . . ., X„ are nonzero numbers; (b) the 

basis e x + e 2 , e 3 , . . ., e n . 

2.2.18. Let the procedure of orthogonalization be applied to an 
arbitrary set of vectors x lt . . ., x h . Prove that (a) if the set x x , . . ., x k 
is linearly dependent, then at some stage of the orthogonalization 
procedure a zero vector is obtained; (b) if the vectors y x , . . i/i-j 
(l < ft) obtained in the orthogonalization process are nonzero vectors 
and y t = 0 , then, in the original set of vectors x x , . . ., x ft , the subset 
x lt . . ., ij-j is linearly independent and the vector x t is linearly 
dependent on this subset. 

Applying the orthogonalization procedure, construct orthogonal 
bases for the subspaces spanned by the given sets of vectors: 

2.2.19. x 2 = (2, 3, -4, - 6 ), 2.2.20. x x = ( 1 , 1 , - 1 , -2), 

x 2 m (1, 8 , -2, -16), x 2 = (-2, 1, 5, 11), 

x 3 = (12, 5, -14, 5), x, = (0, 3, 3, 7), 

x 4 = (3, 11 , 4, -7). t x 4 = (3, -3, -3, -9). 


2.2.21. Prove that if 
= (an, a i 2 , a 18 , 
x 2 = ( 0 , a 22 , a 23 , 
x 3 = ( 0 > 0 , a 33 , 


* ( 0 , 0 , 0 , 


t set of vectors of the arithmetic space R n 

•, «ln), 

a 2n ), 

a 3n ), 


.«) 


forms an orthogonal basis for this space, then (a) a lt # 0 , i = 1 , . . . 
. . ., n; (b) a u = 0 if i # j. 

2.2.22. * In the space R n (n >• 1) there is an orthogonal basis 
e lt . . ., e n such that all the components of each of the vectors e t 
are either 1 or —1. Prove that the dimension of the space R n is either 
2 or a multiple of 4. 

2.2.23. * Given a linearly independent set of vectors x^ . . ., x h 
and two orthogonal sets of nonzero vectors y x , . . ., y h and z lt . . ., z h 
such that the vectors y t and z t are linearly expressed in terms of 
x lt . . ., x ( (i = 1, . . ., ft), prove that y t = a ( z ( (i = 1, . . ., ft) 
where a ( 0 . 

2.2.24. A scalar product is defined arbitrarily for the space M n 
of polynomials with real coefficients of degree Prove that in 
the Euclidean space so formed (a) an orthogonal basis exists contain¬ 
ing one polynomial of each degree ft, 0 ^ ft ^ n; (b) if / 0 (t), f x (J), .. . 
...,/„ (t) and g 0 ( t ), g 2 (t), . . ., g a (0 are the two orthogonal bases 
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possessing the above property, then the polynomials enumerated in 
the same way making up these bases are different only in scalar 
multipliers, i.e. g, ( t) = a,/ ( (t ), i = 0, 1 , . . ., n. 

2.2.25. Let e lt . . ., e„ be an arbitrary basis for a real linear space 
V. Prove that the scalar product may be defined for the space V so 
that the set of vectors e lt . . ., e n may be an orthonormal basis for 
the obtained Euclidean space. 

2.2.26. Define the scalar product for the space M„ of polynomials 
of degree so that the basis 



becomes orlhonormal. 

2.3. Orthogonal Complement, 

Orthogonal Sums of Subspaces 

The principal goals of this section: 

To show the various properties of what will become a very important notion, 
that of an orthogonal complement to a subspace. 

To provide computational problems on how to find orthogonal complements 
and, in particular, to underline the relation of these problems to the solution of 
systems of linear equations. The problem on the perpendicular (see Problems 
2.3.10 to 2.3.14) is also included into this category. 

To indicate the important corollary of the theorems about orthogonal com¬ 
plements that is the existence, for any basis for a Euclidean space, ofa biortho- 
gonal basis. 

To note the similarity between the theorems about the direct sums of sub¬ 
spaces of a linear space and the theorems concerning the orthogonal sums in 
a Euclidean space. In particular, the decomposition of a Euclidean space into 
the orthogonal sum of subspaces is the analogue of a decomposition in terms of 
an orthonormal basis and in the sense the subspaces that yield a given linear 
space when directly summed, play the role of a generalized basis for the whole 
space. 

2.3.1. Let L be a fc-dimensional subspace of a Euclidean space 
E, k <. n. Prove that there is in E a nonzero vector orthogonal to all 
vectors of L (or, in other words, a vector orthogonal to the subspace L). 

2.3.2. Prove that the set L x of all vectors orthogonal to a linear 
subspace L is also a linear subspace. L 1 is called the orthogonal 
complement of the subspace L. 

2.3.3. Let L be an arbitrary subspace of a Euclidean space E. 
Prove that E is the direct sum of the subspaces L and L L . Note 
the relation between the dimensions of the subspaces L and L L that 
follows from the statement. 

2.3.4. Prove that the orthogonal complement of a linear subspace 
of a Euclidean space E possesses the following properties: 

(a) ( L^ = L; 

(b) if L x cr L t , then L\ cz L$\ 
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(c) (L x + l 2 )i - Li n ; 

(d) (Lj n^) 1 = L| +Li; 

(e) L-l = 0, 0 1 = E. 

Here 0 is the null subspace containing the zero vector only. 

2.3.5. The direct sum of subspaces L 1 and L 2 produces a Euclidean 
space E. Prove that the same holds for their orthogonal complements, 
i.e. E = Li + Li. 

2.3.6. Find a basis for the orthogonal complement L 1 of the span 
L of the following set of vectors jR 4 : 

x x = (1, 3, 0, 2), x 2 = (3, 7, -1, 2), x 3 = (2, 4, -1, 0). 

2.3.7. In a Euclidean space E, an orthonormal basis e lt . . ., e n 
is fixed. Prove the following: 

(a) If 

a u«i + a 12 a 2 + . . . + a ln a n = 0, 

a 21 a l *i a 22 a 2 + • • • + &2n a n ~ 0 * 


flmiai + a n*2 a 2 + . . . + ®mn®n = 0 
is an arbitrary set of linear equations in n unknowns, then the set 
of vectors z, whose coordinates with respect to the basis e x , . . e n 
satisfy this system, is a linear subspace of the space E. The dimen¬ 
sion of this subspace equals ft — r where r is the rank of the following 
set of vectors of the arithmetic space: 

ft, = (a u , a 12 , . . ., a ln ), 
n 2 = ( fl 21* a 22> • • •« ®2n)> 


n m — ( a mlt a m2i • • •> a mn)i 

(b) any subspace L of the space E may be described by a particular 
system of linear equations. This means that a vector z belongs to the 
subspace L if and only if its coordinates in the basis c lf . . ., e n 
satisfy the given system. If r is the dimension of the subspace L, 
then any system describing this subspace consists of not less than 
ft — r equations; in addition, there exists a system consisting of 
precisely n — r equations; 

(c) systems of linear equations describing the subspacc L and its 
orthogonal complement L 1 in a given basis are related to each other 
as follows: the coefficients of the system describing one of these 
subspaces act as the coordinates of the vectors spanning the other 
subspace. 

2.3.8. In the space M n of polynomials with real coefficients of 
degree ^ft a scalar product for the polynomials / ( t) = a, + a x t + 
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+ . . . + a n t n and g (t) = b 0 + b^t + . . . + b n t n (in which higher- 
order coefficients of the polynomials may be equal to zero) is defined 
by the formula 

(A g) = a 0 b 0 + aA + . . . + a n b n . (2.3.1) 

Find the orthogonal complement of (a) the subspace of all polynomials 
satisfying the condition / ( 1 ) = 0 ; (b) the subspace of all even poly¬ 
nomials of the space M n . 

2.3.9. Find the systems of linear equations that describe the sub¬ 
space L defined in Problem 2.3.6 and that describe its orthogonal 
complement L L . 

2.3.10. Let L be a linear subspace of a Euclidean space E. Prove 

that any vector x from E can be represented, in a unique way, as 
x = y + z where y belongs to L and z is orthogonal to L. The vector 
y is called the orthogonal projection of the vector x on the subspace L, 
and z is called the perpendicular drawn from x to L. Find, for the 

given subspace L and vector x , a method of evaluating y and z. 

2.3.11. * Let x lt Xj, . . ., x h be an arbitrary set of vectors in a 
Euclidean space E. Prove that for any vector x from E the system 
of linear equations 

(®i» *i) «i + (*i, *i) a 8 + • • • + (x k , Xl ) a h = (x, x 4 ), 

(*i. Xj) a, + (Xj, *j) a 4 + . . . + (x„, Xj) a* = (x, x 2 ), 


(x„ x ft ) a x + (x 2 , x fc ) a, + . . . + (x„, x ft ) a h = (x, x h ) 
has at least one solution. In which case is the solution unique? 

Find the orthogonal projection and perpendicular drawn from the 
vector x to the subspace L. 

2.3.12. x = (14, —3, — 6 , —7). L is spanned by the vector = 
= (-3, 0, 7, 6), y t = (1, 4, 3, 2), y 3 = (2, 2, -2, -2). 

2.3.13. x = (2, —5. 3, 4). L is spanned by the vectors y x = 
= (1, 3, 3, 5), y t = (1, 3, -5, -3), y 3 = (1, -5, 3, -3). 

2.3.14. x = (—3, 0, —5, 9). L is determined by the system of 
equations: 

3a x + 2 a s + a 3 — 2 a 4 = 0 , 

5a! + 4a 2 + 3a s + 2a 4 = 0, 
o*i + 2a s + 3a, + 10a 4 = 0. 

2.3.15. Two sets of vectors x lt . . ., x k and y u . . ., y k in a Eucli¬ 
dean space are called biorthogonal if 

{ 1 when i = /, 

0 when i=/=/. 

Prove that each of the two biorthogonal sets of vectors is linearly 
independent. 
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2.3.16. Prove that a unique biorthogonal basis exists for any 
basis of a Euclidean space. 

2.3.17. Let e x , . . ., e„ and f x ./„ be a pair of biorthogonal 

bases for a Euclidean space. Prove that for any k, 1 ^ A- < n the 
orthogonal complement to the subspace spanned by the vectors 
e x , . . ., e h coincides with the span of the vectors / h+1 , . . ., /„. 

Find biorthogonal bases to the following bases of the space /?,: 


2.3.18. e x = (1, 0. 0. 0), 
e 2 = (0, 2, 0, 0), 
<? 3 = (0, 0, 3, 0). 
e 4 = (0, 0. 0, 4). 

2.3.20. = (1, 1, 1, 1), 

e 2 = ( 0 , 1 , 1 , 1 ), 
* 3 = ( 0 , 0 , 1 , 1 ), 
e 4 = ( 0 , 0 , 0 , 1 ). 


2.3.19. e x = ( 1 , 0, 1, 0), 
e 2 = ( 0 , 1 , 2 . 0 ), 
e 3 = (0, 0, 1, 0), 
e 4 = (0, 0, 3, 1). 

2.3.21. e x = (1, 1, 1, 1), 

e 2 = ( 1 , 1 , - 1 , - 1 ), 
e 3 = (1, -1, 1, -1), 
e 4 = (1, -1, -1, 1). 


2.3.22. In a Euclidean space E biorthogonal bases e x , . . e„ 
and f lt ...,/„ are fixed. Prove that 


(a) if x is an arbitrary vector from E, then in its decomposition 
in terms of the basis e x , . . ., e„ viz. x = afa + . . . + ot n e n , the 
coefficients a t are determined by the formulae a t = (x, ft), i = 
= 1 , . . ., n; 

(b) the scalar product of arbitrary vectors x and y is determined 
by the formula 


(*. y )=(*. ft) (y- e i)= a.P i 


where p 4 , . . ., p n are the coefficients of the decomposition of the 
vector y in terms of the basis / lt . . ., /„. 

2.3.23. The linear subspaces L x , . . L p of a Euclidean space E, 
are mutually orthogonal (this means that, for each subspace L t , any 
vector of that subspace is orthogonal to all the other subspaces). 
Prove that the sum of the subspaces L x , . . L p is their direct sum. 
(The sum of mutually orthogonal subspaces is called their orthogonal 
sum and denoted by L x © ... © L p .) 

2.3.24. Prove that the sum L of subspaces L x , . . ., L p is their 
orthogonal sum if and only if the union of the orthogonal bases for 
these subspaces yields the orthogonal basis for L. 

2.3.25. Prove the associative law for the orthogonal sum of sub¬ 
spaces, i.e. if L = L x © L and L = L 2 © L 3 , then 

L = L x © L 2 © L 9 . 
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2.3.26. The direct sura of the subspaces L x , . . L p yields a 

Euclidean space E. Prove that this sum is orthogonal if and only if 
for any vectors x and y from E, decomposed in terms of the subspaces 
Lj, . . L p , respectively: x = Xj + . . . + x p and y = + . . . 

. • . + J/j>, their scalar product satisfies the equality 

(*, y) = (z„ yj + . . . + (x P , y p ). 

2.3.27. A linear space V is arbitrarily decomposed into the direct 

sum of subspaces, i.e. V = L 1 + L p . Prove that a scalar 

product for V may be defined so that every pair of the subspaces L t 
is orthogonal. 


2.4. Lengths, Angles, Distances 

We intend in this section: 

To provide a number of simple problems regarding the definitions of the 
length, angle, and distance, and corroborating the validity of elementary 
Euclidean geometry theorems in an arbitrary Euclidean space. 

To interpret the problem of decomposing a vector in terms of the orthogonal 
complementary subspace as the problem of determining the least distance from 
the vector to the subspace. 

To determine the angle between a vector and a subspace and show that this 
definition generalizes the notion of an angle between a vector and a plane in 
three-dimensional Euclidean space. 

2.4.1. Prove that the lengths of the vectors x and y = ax satisfy 
the equality 

I v I = I a | | x |. 

2.4.2. How is the angle between nonzero vectors x and y altered 
if: (a) the vector x is multiplied by a positive number; (b) the vector x 
is multiplied by a negative number; (c) both vectors x and y are 
multiplied by negative numbers? 

In the subsequent problems the ordered set of three vectors x, y 
and x — y in an arbitrary Euclidean space is called, just as it is in 
three-dimensional Euclidean space, a triangle "generated by or drawn 
on the vectors x and y". Accordingly, the parallelogram generated 
by the vectors x and y is considered to have the vectors x + y and 
x — y as its diagonals. 

2.4.3. Prove that the triangles generated by vectors x, y, and 
ax, ay respectively, where a is an arbitrary nonzero number, have 
equal corresponding angles. 

2.4.4. Find the lengths of the sides of the triangle generated by 
the vectors of the space R 4 x = (2, —1, 3, —2) and y = (3, 1, 5, 1). 
Find the angles between the sides of the triangle, i.e. vectors x, y 
and x — y. Which of these angles is it natural to consider as interior 
and exterior angles of the triangle? 

2.4.5. Formulate and prove the cosine law for a triangle generated 
by vectors x and y in an arbitrary Euclidean space. 
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2.4.6. Determine whether the triangle generated by the poly¬ 
nomials t 2 + 3 1 and 2 1 2 + 2 i — 1 is acute-angled or obtuse-angled 
if the scalar product of the polynomials / ( t) = a 0 + a x t + a 2 t 2 
and g ( t ) = b 0 + b x t + b 2 t 2 is given by the following formulae (a) 
(/. g) = <*ot>o + &ibi + a 2 b it (b) (/, g) = a 0 b 0 + 2 a x b x + a 2 b 2 . 

2.4.7. Prove Pythagoras theorem and its converse, viz. that two 
vectors x and y of a Euclidean space are orthogonal if, and only if, 

I x — y | 2 = | x | 2 + | y | 2 . 

2.4.8. Prove that for an arbitrary triangle in a Euclidean space 
(a) the length of each side does not exceed the sum of the lengths of 
the other two sides; (b) the length of each side is not less than the 
absolute value of the difference of the other two sides. 

2.4.9. Prove that in a parallelogram generated by vectors x and y, 
the sum of the squares of the lengths of the diagonals equals the sum 
of the squares of the lengths of the sides. 

2.4.10. Prove that | x | = | y | if, and only if, the vectors x + y 
and x — y are orthogonal. Specify the geometric sense of the state¬ 
ment. 

2.4.11. Let e x , . . ., e n be an orthonormal basis for a Euclidean 
space, and x be an arbitrary formalized vector. Prove that the coor¬ 
dinates of the vector x in the basis e lt . . ., e n are equal to the cosines 
of the angles o lt . . ., a„ formed by x and the basis vectors. Hence 
deduce the relation 

cos 2 a x + cos 2 a, + . . . -f cos 2 o„ = 1 . 

2.4.12. The number 

p (x, y) = | x — y | 

is called the distance between vectors x and y of a Euclidean space. 
Show that the distance thus defined satisfies the triangle inequality 

P (*. z)< P (x, y) + P (y, z), 

for any three vectors x, y, z. 

2.4.13. Prove that, in the triangle inequality for vectors x, y 
and z, the equality sign appears if, and only if, (x — y) = a (y — z), 
a > 0 . 

2.4.14. In the space M n of polynomials of degree a scalar 
product for polynomials f (t) = a 0 + a x t + ... + a n t n and g ( t) = 
= b 0 + V + • • • + M n is defined by formula (2.3.1). Given 
polynomials 

/i (t) = 3 1* + 2t + 1 , / 2 (t) = -t* + 2t + 1 , 

/a (t) = 3 1* + 2t + 5, h (t) = 31 2 + 5t + 2, 

(a) find a polynomial /„ ( t) of degree ^2 equidistant from f x (t), 

U (t ), /a (0. /4 ( t ); 
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(b) find the distance between / 0 (f) and each of the polynomials 
h (*), U ( t ), fs ( 0 . /4 ( 0 ; 

(c) prove that any polynomial of the form 

U (0 + m s^ + • • • + "Int* 

is also equidistant from / 2 (f), / 2 (t), / s (f), / 4 ( t ), and find the distance 
between these polynomials. 

2.4.15.* Given a subspace L and an arbitrary vector x of a Eucli¬ 
dean space, the number 

p (x, L) = inf p (x, y) 

VtL 

is called the distance between the vector x and subspace L. Prove that 
(a) the distance p (x, L) is equal to the length of the perpendicular 
drawn from x to L\ (b) the nearest vector of the subspace L to the vec¬ 
tor x is the orthogonal projection of x on L\ (c) for any y from L, 
p (x + y, L) = p (x, L). 


2.4.16. * A subspace L is the orthogonal direct sum of subspaces 
L x and L 2 . If a vector x is orthogonal to the subspace L lt prove that 

P (*. L) = P (*. L J- 

2.4.17. * Let a be a fixed vector in a Euclidean space, and let L 
be the subspace of all vectors orthogonal to a. Prove that the distance 
between an arbitrary vector x and the subspace L may be found by 
the formula 


2.4.18. A scalar product for the space M„ of polynomials of degree 
is computed in terms of the coefficients of the polynomials by 

Formula (2.3.1). Find the distance between the subspace M n . x of all 
polynomials of degree — 1 , and (a) the polynomial t n ; (b) the 
polynomial t n + a n -jt " -1 + . , . + «j( + « 0 ; (c) the polynomial 
at n -j- a n t n ~i —... —J— Ujf -f- Uq. 

2.4.19. In the space M n with the same scalar product as defined 
in (2.3.1), consider the subspace L of all polynomials fulfilling the 
condition / (1) = 0. Prove that the distance between an arbitrary 
polynomial g ( t) and the subspace L equals 




2.4.20.* Given a subspace L and vector x of a Euclidean space, 
the least angle formed by x with any vector from L is called the 
angle between the vector x and subspace L. Prove that the angle between 
x and L is equal to the angle between x and its orthogonal projection 
y on L. Show that vectors of the subspace L form the same angle with 
the vector x if, and'only if, they are of the form ay, a > 0 . 
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2.4.21. Prove that the sum of the angle formed by-a vector x 
with an arbitrary subspace L, and of the angle formed by x and the 
orthogonal complement L x equals ji/2. 

2.4.22. A Euclidean space E is resolved into the orthogonal sum 
of subspaces L lt . . L p . Prove that the angles a lt . . a p formed 
by an arbitrary vector x with the subspa'ces L lt . . ., L p satisfy the 
relation 

cos 2 a x + cos 2 a 2 + • • • + cos 2 a p = 1 . 

Compare this formula with the formula obtained in Problem 2.4.11. 

2.4.23. A subspace L is the orthogonal sum of subspaces L x and 
L 2 . A vector x is orthogonal to the subspace L v Prove that the angle 
between x and L equals the angle between x and L 2 . 

Find the angle between the vector x and linear subspace L gener¬ 
ated by the vectors y lt y t , y 3 : 

2.4.24. x = (-3, 15, 1, -5); 2.4.25. x = (3, 1, VI, -2); 

if, = (2, 3, -4, - 6 ), yi = (2, - 1 , 2, 1), 

y 2 = (1, 8 , - 2 , -16), y z = (-1, 2 , - 2 , 1), 

y 3 = (1, -5, -2, 10). y 3 = f-1, 1, -1, 0). 

2.5. Unitary Spaces 

Most of the problems in the present section are similar to the problems on 
Euclidean spaces given earlier. We intend to show, by this similarity, that the 
basic results proved for the case of a Euclidean space remain valid for arbitrary 
unitary spaces as well. At the same time, we hove also attempted to illustrate 
the theoretical differences between the real and complex cases, particularly for 
geometric theorems. We describe, in conclusion, a technique for transferring 
from a Euclidean to unitary space (the so-called “complexificalion" of a unitary 
space), and the inverse transfer (the “decomplexification”). 

2.5.1. Prove that it follows from the axioms of the scalar product 
on a unitary space that (a) (x, y 2 -f y t ) = (x, y t ) + (x, y 2 ), for any 
vectors in a unitary space; (b) for any vectors x and y in a unitary 
space and any complex number a, (x, ay) — a (x, y); (c) ( 0 , x) = 
= (x, 0) = 0; 

(d) (2 <z,x„ 2 t hyj )= t S a $j (*•' y^ 

2.5.2. Prove that the scalar product may be defined for any com¬ 
plex linear space. 

2.5.3. Define the scalar product for the n-dimensional complex 
arithmetic space C„. 

2.5.4. Define the scalar product for the space of polynomials with 
complex coefficients of degree regarded as a complex linear 
space under the usual operations for the addition of polynomials and 
the multiplication of a polynomial by a complex number. 
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2.5.5. Prove that the scalar product of the vectors x = 
= (a^ a 2 , . . ., a„) and y = (P^ p 2 , . . ., p„) can be defined for the 
space C n by the formula 

(i, y) = a 11 a ) jj, + a 12 a,p 2 + ... + ai n a,p„ 

+ + a 2z aji 2 + ... + a 2n a& n 


+ amanPi + a n 2 a n P 2 + • • • + a nn a„p„ 

on condition that 

(a) a tJ = a Jl , for all i, ;; 

(b) a lt > fj |a„ |, i = 1 , ..n. 

ul 

2.5.6. Prove that the scalar product of two vectors x and y is 
expressed in terms of their coordinates by the formula 

(x, y) = a,p, + a 2 ^ + ... + a n p n 

if, and only if, the corresponding bases of the unitary space are 
orthonormal. 

2.5.7. Prove the Cauchy-Buniakowski inequality for the case of 
a unitary space 

I (*. V) I* < (*. x) (y, y). 

Hence deduce the relation 

IS «iPil 2 <(S |«|| 2 )(S IP, I 2 ) 

1=1 1=1 1=1 

where a lt . . a„ and P lt . . ., P„ are arbitrary complex numbers. 

2.5.8. Prove that the Pythagoras theorem remains valid in an 
arbitrary unitary space, viz., if vectors x and y are orthogonal then 

11 — V I 2 = I x | a + | y | 2 . 

Show, however, that the converse theorem is incorrect. 

2.5.9. Prove that vectors x and y of a unitary space are orthogonal 
if, and only if, for any numbers a and p 

I ax + py | 2 = | ox | a + | py |*. 

2.5.10. Prove that the statement of Problem 2.4.10 does not hold 
in the case of a unitary space. Which statement, precisely, of the 
two listed in the problem becomes invalid? 

2.5.11. Prove, however, that the statement of Problem 2.4.9 

|x + y| 2 +|x-y | 2 = 2 |x | 2 + 2 |y | 2 
is also valid for a unitary space. 


4-oeie 
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2.5.12. Prove the equality 

4 (x, y) = | x + y | a — | x — y |» + i |x + iy |* — £ |x — iy |». 

(2.5.1) 

2.5.13. * Let R be a real space and C the set made up of all formal 
sums x + iy where x £ R, y £ R. Prove that 

(a) the set C is a complex linear space if the linear operations are 
defined for it by the formulae 

(xi + 4/i) + ( x * + iy*) = (*i + * 2 ) + i (jh + y*), 

M* + iy) = (a + *P) (X + iy) = (OCX — p y) + i (ay + 0x) 

where X = a + ip is an arbitrary complex number; 

(b) a set of vectors x v . . x h of the space R is linearly dependent, 
or independent, when the set of vectors x 1 + £0, . . ., x h + £0 of the 
space C is linearly dependent, or independent; 

(c) the dimension of the space C equals the dimension of the space R. 
The technique just described for constructing a complex space from 

a given real linear space R, and with the same dimension is called 
the complexification of the space R. 

2.5.14. Let R be a Euclidean space with scalar product (x, y), 
and C the complex space obtained from R by the complexification. 
Prove that 

(a) the space C can be converted into a unitary space if the scalar 
product is determined by the formula 

<x x + iy L , x a + iy t ) = [(x„ x s ) + (y u y a )] + i [(y„ x a ) - (x u y 2 ) 1; 

(b) if e lt . . ., is an orthogonal set of vectors from R, then the set 
of vectors e x + iO, . . ., e k + iO from the space C with the scalar 
product just given is also orthogonal; 

(c) if e v . . ., c„ is an orthonormal basis for R, then e 1 + 10, . . . 

. . ., e„ + iO is an orthonormal basis for C. 

2.5.15. Complexify the n-dimensional real arithmetic space R n 
(with the customary scalar product). What sort of complex space is 
obtained? 

2.5.16. Let C be an arbitrary complex space. Prove that the set 
of vectors forming C can, at the same time, be also considered as a 
real linear space R in which (a) the operation of addition coincides 
with that on C\ (b) for any real number a and any vector z, 

az = (a + £0) z, 

where the right-hand side of the equality is the product of the vector z 
by the number a + £0, and is defined in C. The transfer from the 
complex space C to the real space R is called the decomplexifvcation 
of the space C. 
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2.5.17*. Let C be an re-dimensional complex space obtained from 
if by the decomplexification. Prove that 

(a) if z x . is a linearly independent (or linearly dependent) 

set of vectors of the space C, then z lt iz lt . . z k , iz h is a linearly 
independent (or linearly dependent) set of vectors in the space R 
(the product izj is defined by the same rule as for C, and is an element 
of this space and, therefore, an element of the space if); 

(b) the dimension of the space R equals 2re; in addition, to any 
basis e lt . . ., e n in the space C there is a corresponding basis e u ie lt .. . 
. . ., e n , ie n for the space R. 

2.5.18*. Let C be an re-dimensional unitary space with the scalar 
product ( x , y) and if the real space obtained from C by decomplexific¬ 
ation. Prove that 

(a) the space if can be converted into a Euclidean space by defining 
a scalar product for it by the formula 

(z lt z t ) = Re (z lt z 2 ); 

(b) for any vector z from C, the vectors z and iz, considered as 
elements of the obtained Euclidean space, are orthogonal; 

(c) if e Jt . . ., e h is an orthogonal set of vectors from C, then the 
set of vectors e v ie v . . ., e h , ie h is orthogonal in if; 

(d) if e lt is an orthonormal basis for C, then e v ie lt . . e nt 

ie n is an orthonormal basis for if. 

2.5.19. Prove that the decomplexification of the re-dimensional 
complex arithmetic space C n can be performed by matching each 
vector z = (a x + i$ u . . ., o„ + ifl n ) from C n with the vector 
(<*!, . . ., a n , P 1( • • ., Pit) from the real arithmetic space R tn . Which 
vector in if 2n corresponds to the vector iz? Which scalar product is 
induced in if ln if, in C„, the customary scalar product of z = 
= (Xj, . . ., X n ) and w = (p 1( . . ., p„) is defined as follows: (z, w) = 
= + . . . + X„p„? 


4* 
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3.0. Terminology and General Notes 

Let * lt x 2 , . . ., x n be an arbitrary set of 
vectors of an n-dimensional Euclidean or unitary space, and let 

L 0 = O, L k — L (* lt . . x h ). 

Denote the perpendicular drawn from x h to the subspace L k . x by y h . 
The number 

V(x t , x 2 .«.)-]][ |*| (3.0.1) 

is known as the volume of the parallelepiped drawn on the set of 
vectors x u x 2 , . . x n . It is evident that the volume of such a paral¬ 
lelepiped equals zero if, and only if, the set x v x 2 , . . ., x n is linearly 
dependent. Since 

I y* I < I I* A = 1, .... n, 

the volume of a parallelepiped satisfies Hadamard's inequality 

V(x v x 2 .*„)<n 1**1 (3.0.2) 

h=t 

and the equality is upheld here if, and only if, either there is at least 
one nonzero vector among the vectors * lt x 2 , . . x n or each pair of 
these vectors is orthogonal. 

Following V. Voyevodin we will define axiomatically an oriented 
volume V ± (* lt x 2 , . . ., x n ) of the parallelepiped drawn on the set of 
vectors * lt . . ., x n . Viz., we shall require that the following con¬ 
ditions should be fulfilled: 

(1) V ± (* lt x 2 , . . ., *„) is a linear function for each of its vector 
arguments; 

(2) V ± (x l , x 2 , ...,*„) = 0 if the set * lt x 2 , . . ., x n is linearly 
dependent; 

(3) V ± (e x , e 2 , . . ., e„) = 1, for a certain orthonormal basis. 

It can be shown (see V. Voyevodin, Linear Algebra, Mir Publishers, 

1983, Chapter 4) that an oriented volume of a parallelepiped exists, 
and its modulus equals the volume of this parallelepiped. In par- 
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ticular, the condition 


V ± (* lt x 2 , . . ., x„) = 0 

turns out to be necessary and sufficient for the set of vectors x lt x 2 , . . . 
.... x n to be linearly dependent. 

Since an oriented volume is not uniquely defined, then to single 
out a concrete oriented volume it is necessary to give an orthonormal 
basis e lt e t , . . e n with respect to which it will assume unit value. 
A square number table with n rows and n columns 



a u 

a, 2 . 


A = 

a Zi 

0-22. • 

• o ln 


a ni 

a i>2 • 

■ • a nn 


is called a square matrix of order n. The elements a t] of a matrix A 
can be real or complex numbers. Accordingly, we will speak of real 
and complex matrices. 

The elements a n , a 22 , . . ., o nn are said to constitute the principal 
diagonal of a matrix A, all the other elements a l} , i /, being called 
the off-diagonal elements. A matrix all of whose off-diagonal elements 
are zero is called a diagonal matrix. A diagonal matrix is called the 
unit matrix if all elements on the principal diagonal of this matrix 
are equal to unity. Another term is the secondary diagonal of a matrix 
A, its elements being a ln , o 2<n _ x , . . ., a nl . 

The algebraic sum of w! terms is called the determinant of a matrix A 
if these terms are all the possible products of n of the elements of the 
matrix taken one in each row and in each column. The term ai 0l , 
a 20tt • • ■ a no has a plus sign if the permutation a x , a 2 , . . ., a„ 
contains an even number of inversions, and a minus sign otherwise. 
An inversion of the numbers a ( and aj exists when a t > aj but a l 
precedes a } in the permutation a lt . . ., a„. We will denote, here¬ 
after, the determinant of a matrix A by | A | or by det A. 

If all the rows of a matrix A are regarded as vectors of an n-dimen- 
sional arithmetic space, then the determinant det A is nothing but 
an orientation volume of a parallelepiped in this space, the corres¬ 
ponding orthonormal basis being the standard basis (1.0.1). Hence 
it follows that 

(i) det A is a linear function of the matrix A; 

(ii) det A = 0 if and only if the rows of the matrix A are linearly 
dependent. The matrix is called degenerate if its determinant is 
equal to zero, and nondegenerate otherwise; 

(iii) the value of the determinant of a matrix is unaltered by ad¬ 
ding to a row a linear combination of the other rows; 

(iv) the determinant changes sign when two rows are interchanged. 
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The transposition of a matrix A is that transformation of a matrix 
where the matrix rows are interchanged with the columns that have 
the same index number T. A T is the transpose of matrix A 


<*li 

<*21 • 

• <*nl 

<*12 

<*2 2 • 

• <*na 

<*ln 

<*2n •• 

■ • <*nn 


Transposition leaves the determinant of a matrix unaltered: det A = 
= det A T . Hence the above properties, valid for the rows of a 
matrix, are also valid for its columns. 

Choose any k rows with indices i lt i t , . . ., i h and k columns with 
indices / x , / 2 , . . j h from a matrix A. A matrix of order k, whose 
determinant is called the minor of order k of the matrix A (or its 
determinant) emerges from the intersection of these rows and columns. 
In particular, minors of order 1 are the elements a l} . To indicate the 
position of the minor, being considered, in a matrix A, the following 
designation is used 

(3 -°- 4> 

If, further, the indices of the rows coincide with the indices of the 
columns, then we will use the shorter notation: A (iji, . . . i*). 

If the rows with indices i lt . . ., i h and columns with indices 
hi • • •» jh are deleted from the matrix A, then the remaining minor 
•of order n — k is called the complementary minor of the deleted 
minor (3.0.4). The cofactor of minor (3.0.4) is defined to be its com¬ 
plementary minor multiplied by (—1)’" where 

s m — *i + It + • • • + ih + /i + /» + •••+ ih- 
The cofactor of the element a t j is denoted by A t j. 

There is held the following 

Laplace theorem. Let k rows (or k columns) of a matrix A be chosen 
arbitrarily 1 ^ k ^ n — 1. Then the determinant det A is equal 
to the sum of the products of all the minors of order k, and their 
cofactors in any row or columns of A. 

In a particular case, the Laplace theorem yields the following 
formulae for expanding a determinant by a row'. 

a n^n + <*<2-4 j 2 + . . . + a tn A ln = det A, (3.0.5) 

<*11-4/1 + <*12-4/2 + • • ■ + <*ln-4/n = 0, 1=5^/. 

It is evident that similar formulae for expanding a determinant by 
a column are also valid. 

Let us make some other notes concerning the methods of evaluating 
the determinants used in the present chapter. 
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It can be seen from Sec. 1.0 that Gaussian elimination reduces a 
square matrix to a triangular form. Due to Properties 3 and 4 of 
determinants above, the transformations used in doing so can only 
change the sign of the determinant. The determinant of a matrix of 
triangular form equals (see 3.1.8) the product of the entries on the 
principal diagonal and the application of Gaussian elimination 
relies on just this fact. Different aspects of the method are discussed 
in detail in 3.4. 

Let us now describe the method of iterative formulae which can be 
used for evaluating tridiagonal determinants of the following form: 
la b 0 ... 0 0 I 


cab 

Oca 


0 0 0 . 

0 0 0 . 


(3.0.6) 


Consider then set s of infinite numerical sequences 

x = ( a u a 2 , . . ., a n , . . .). (3.0.7) 

Assume, for example, that they are complex. Define linear operations 
on these sequences by the formulae: 

(i) Xx = (Vxj, Xa 2 . Xa n , . . .); 

(ii) if y = (p lf P,-- P„, . . .), then 

i + y = K + Pi, « 2 + p 2 .cc„ + P„, • . .) 

and it is obvious that s becomes a linear space. 

The set F of all sequences (3.0.7), for whose elements the iteration 
formula or the difference equation of the second order holds 

On = pan-i + ga„_ 2l n = 3,4,..., (3.0.8) 

(where p and q are fixed numbers and q =£ 0), is a subspace of s. 
It is easy to see that the dimension of the subspace F equals 2. Let 
us show how to construct a basis for this space. 

Form the algebraic equation (called the characteristic equation) 
from the coefficients of the difference relation (3.0.8) 

X 2 — pX — q = 0. 

Two cases must be considered here: 

(i) The roots ^ and X 2 of the characteristic equation are different. 
In this case the basis for the subspace F is made up of the sequences 

<?, = (*„ K K ...), 

e 2 = (X 2 , XJ, X\, 






56 


Determinants 


Ch. 3 


(ii) The characteristic equation has a root of multiplicity 2. In 
which case the basis for F consists of the sequences 

e, = (X, X*. W .X", ...), 

e 2 = (1, 2A., 3X2, ... t n xn- i, ...j. 

Any sequence (3.0.7) belonging to f can be decomposed in terms 
of the basis e v e 2 thus: 

x = c x e x + c 2 e 2 . 

In terms of the components this relation is translated into 
a n = CjX” + c 2 X 2 

for case 1, and 

a„ = qX" + c 2 nk n ~ l = X n_1 (c x X + c 2 n) 

for case 2. 

The coordinates c, and c 2 of the sequence x may be determined by 
its first two components only. These are the solutions of the system 
of linear equations 

XiCj + % 2 c 2 = Oj, 

XJc x + X*c 2 = a 2 , 
or 

Xc, + c 2 = a 1( 

X 2 Cj + 2 Xc 4 = a 2 

according as which case is considered. 

Returning to determinant (3.0.6) and expanding it along the last 
row, we obtain 

D„ = aD„. x — bcD„- 2 , n = 3, 4, . . ., 
i.e. an iterative relation of the second order. Here 
D x = a, 

D 2 — a 2 — be, 

and the above construction may be performed. 


3.1. Evaluation and the Simplest 
Properties of Determinants 

A customary set of problems on the evaluation and the simplest properties 
of determinants is presented in this section. We mean by this the linear prop¬ 
erties, invariance on transposition, changing sign on the interchange of rows 
(or columns), the existence of a zero determinant when its rows (or columns) are 
linearly dependent. 

Can a determinant of the seventh order have any of the following 
products of its elements as one of its terms? If so, what are their 
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respective signs? 

3.1.1. a « <*71 <*23 <*67 <*34 <*12 <*M- 

3.1.2. a 23 a 62 a 77 a 34 a 3 | a 12 a 46 . 

3.1.3. a 71 a 17 a 26 a 62 a i3 a 36 a 44 . 

3.1.4. a 26 a 3i a 44 a 17 a 63 a 62 a 31 . 

3.1.5. Extend the product of the elements a 13 a 24 a 36 a 4e a 57 of a 
determinant of the seventh order to obtain a term of the determinant 
(a) with a plus sign; (b) with a minus sign. 

3.1.6. Find the relationship between the indices of the elements 
placed (a) on the principal diagonal; (b) above the principal diagonal; 
(c) below the principal diagonal. 

3.1.7. What is the sign of the product of elements on the principal 
diagonal? 

3.1.8. Using only its definition, evaluate the determinant 


a u 

0 

0 . 

.. 0 

a 2i 

a 22 

0 . 

. 0 

<*31 

<*32 

<*33 ■ 

. 0 

<*nl 

<*n2 

<*„3 

.. a nn 


3.1.9. What is the relationship between the indices of the elements 
of a determinant of order n placed (a) on the secondary diagonal; 
(b) above the secondary diagonal; (c) below the secondary diagonal. 

3.1.10. What sign has the product of the elements of the secondary 
diagonal when considered as a term of a determinant of order n. 

3.1.11. Evaluate the determinant using its definition only 


0 . 

. 0 

o <*,„ 

0 . 

. 0 

<* 2 , n-1 <*2n 

. o 

•• <*8. n -2 

<*3, n-1 <*3n 

<*n 1 • 

• • n -2 

<*n, n-1 <*nn 


Using the definition only evaluate the following determinants 


3.1.12. 

0 1 0 ... 0 

3.1.13. 

10 ... 0 1 01 


0 0 1 ... 0 


o 

o 

o 


000 ... 1 


1 ... 0 o o| 


1 0 0 ... 0 


o 

o 

o 
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1 0 0 ... 0 m i} 0 . 

010 ... Only 0 . 

0 0 1 ... 0 m S} 0 . 


0 0 0 
0 0 0 
0 0 0 


0 0 0 ... 1 m M ., 0 ... 0 0 0 

0 0 0 ... 0 1 0 ... 0 0 0 

0 0 0 ... 0 m y+i .y 1 ... 0 0 0 


000 ... 
000... 
000 ... 
3.1.15. II 


0 m n _ 2> j 0 ... 1 0 0 

0 mn-u 0 ••• 0 1 0 

0 m nJ 0 ... 0 0 1 


cos cp ... — sin <p 


1-th row 


sin cp ... cos cp 


i-th row 


1 

| <-th column i-th column | 

The elements of the principal diagonal missed out here are equal to 
unity, and all the other elements are zeroes. 

3.1.16. Show that if, in a determinant of order n, more than 
n 2 — n elements are zeroes, then the determinant equals zero. 

Only with the help of the definition, evaluate the determinants: 


3.1.17. 

0 0 0 1 

3.1.18. 

0 0 5 1 


0 0 0 2 


0 0 6 2 


0 0 0 3 


0 0 7 3 


12 3 4 


12 3 4 

3.1.19.] 

0 0 5 1 



0 0 6 2 



5 6 7 3 

• 


12 3 4 



3.1.20. Prove that if, in a determinant of order n the elements 
placed at the intersections of k rows and l columns are zeroes and 
that k + l > n, then the determinant is equal to zero. 







3.1.24. —t 0 0 ... 0 a t 

a 2 -t 0 ... 0 0 

0 a, — t ... 0 0 


0 0 0 

... — / 0 

| 0 0 0 

... a n — 1| 

3.1.25*. * - 1 o ... 

0 0 

0 t -1 ... 

0 0 

0 0 t ... 

0 0 

0 0 0 ... 

. t -1 

«i a t a, ... 

On-1 <*n+t 

What is the degree of the polynomials in t represented by the fol¬ 
lowing determinants of order n : 

3.1.26. «u+< a u 

Bin 

<*« + * ••• 

0 271 

am ••• 

a nn + < 

3.1.27. «u + f + * • 

.. a in +t 

a 21 a 2» + < • 

a 2n + < 

«i»l a m 

. • a„n +t 
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3.1.28.* Is it always true that a determinant of the following form: 


a ll + *ll< 

a 12 + b 12< • 

■ a m +i>in< 

a 21 + b Sl< 

a 22 + 6 i2 t . 

• b 2Jl +6j n f 

a ni + &ni* 

a n* + J>n2< • 

• ■ a nn +fcnn< 


has degree n if represented by a polynomial in the unknown t ? 

3.1.29*. Find the necessary and sufficient condition for the above 
determinant to he of a degree less than n if it is represented by a 
polynomial in t. 

3.1.30. Find the free term of the polynomial indicated in Prob¬ 
lem 3.1.28. 

3.1.31. How will a determinant with complex entries be altered 
if all the elements are replaced by their respective conjugates? 

3.1.32. How will changing the sign of each of its elements alter 
an n-order determinant? 

3.1.33. If each element of an n-order determinant is multiplied 
by a, how is the determinant altered? 

3.1.34. * How will a determinant be altered if each of its ele¬ 
ments a lh is multiplied by a' - *, where the number a is nonzero? 

3.1.35. The position of an element a ih in a determinant is called 
even or odd according to whether the sum i + k is even or odd. Prove 
that a determinant is not altered by changing sign of all its odd- 
placed elements; if, however, all even-placed elements have their sign 
changed, then an even-ordered determinant remains unaltered, but 
an odd-ordered determinant’s sign is changed. 

3.1.36*. A determinant is called skew-symmetric if its entries, 
symmetric about the principal diagonal, differ in sign, i.e. a t] = 
= — a Jt , for all i, j. 

Prove that a skew-symmetric determinant of odd order equals zero. 

3.1.37. * Prove that the value of a determinant is real if all en¬ 
tries, symmetric about the principal axis are complex conjugates 
(i.e. a tJ = a H for all i, j). 

3.1.38. How will an n-order determinant be altered if each row is 
written in reverse order? Which element of the original determinant 
occupies the i, j entry of the new one? 

3.1.39. Find the element of an n-order determinant symmetric to 
a,j with respect to the “centre” of the determinant. 

3.1.40. How will a determinant be altered if each of its elements 
is replaced by the one symmetric to it with respect to the “centre” of 
the determinant? 

3.1.41. Find the element of an n-order determinant symmetric to 
a t} about the principal diagonal. 

3.1.42. How will a determinant be altered if each element is re¬ 
placed by the element, symmetric about the secondary diagonal? 
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3.1.43.* How will rotating the matrix of an n-order determinant 
through 90° about its centre alter the determinant? 

Solve the following equations whose left-hand side is represented 
in determinant form: 


3.1.44. 

12 3 4 

3.1.45. 

12 3 4 


5-t* 2 3 4 

2 3 5 — i* 1 

=0. 

1+1 2 1+3 4 

1 3+14+15+1 


2 3 4 1 


1 —3 -4 -5 


Evaluate the following determinants: 


3.1 

1.46. 

Zll/l . 






* 2 l/l *2«2 • 

.. x t y n 





*ni/i x n y t . 

•• x n y n 



3.1 

1.47. 

1 

2 


.. n 



» + l 

n + 2 

.. 2n 



»(«-D + l 

n(»-l) + 2 .. 

'. ’ n* 


3.1.48. Let h ( t ), ...,/„ ( t ) be polynomials of degree not greater 
than n — 2. Prove that for arbitrary numbers o lt a 2 , . . a„, the 

determinant 

I /i («.) M«l) ••• /i(«n)| 

M<*i) Maj) ... MM I 


I fn («i) fn (<**) • • • fn («n) I 

equals zero. 

3.1.49. How will a determinant be altered if (a) from each row 
(except the first) the previous row is subtracted; (b) from each row 
(beginning with the second) the previous row is subtracted, and at 
the same time the last of the original rows is subtracted from the first 
row? 

3.1.50. Prove that any determinant equals half the sum of the 
following two determinants: one obtained by adding a number b to 
all elements of the i-th row of the original determinant, and the other 
by adding —b to them. 

Evaluate the following determinants representing them as a sum 
of determinants: 


3.1.51. 


1 + l + *iJ/s ... l+*i#n 

l + *2i/l t+*2l/2 ... l + *2Vn 

.1 l-f*ni /2 
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3.1.52. 

COS (<Xj — Pj) 
cos (a, — Pj) 

cos (a, — P 2 ) • 
cos (ot 2 Pj) • 

. COS (<Xj— p„) 

. cos (a 2 — p n ) 


cos (a n —Pi) 

cos (a„ — P 2 ) .. 

.. cos (a„ — p n ) 


3.1.53*. 


x yVi •■ 

x yVn 


*2</l 

1 + .. 

x 2«n 


x nVi 

x nVt • • 

. l + *n!/n 


3.1.54. 

1 — 2w\ —2w r w t 

. — 2u>iw„ 


— 2u>,u>j \—2w\ 

• -2 io 2 w n 


— 2u»nWi —2 uf n u> 2 .. 

. 1-2 wl 


where u>l + w% + ... + u>£ — 1. 

3.1.55. The numbers 20604, 53227, 25755, 20927, and 78421 are 
all divisible by 17. Prove that the determinant 

2 0 6 0 4 

5 3 2 2 7 

2 5 7 5 5 

2 0 9 2 7 

7 8 4 2 1 

is also divisible by 17. 

3.1.56. All elements of a determinant A are differentiable func¬ 
tions in one variable t. Prove that for the derivative of this deter¬ 
minant considered as a function in t, the following formula is valid 


A'(0 = 

•uM «»(<) •• 

«2l(0 «22 (0 • 

«i'n (0 
°2n (0 







°ni (0 «ni(0 . 

• o nn (0 






+ 

0,1 (0 01,(0 
««(*) ««(*) • 

«in(0 
• *in (0 

+ .. 

. + 

«» <o 
®21 (0 

o„(0 .. 
022 (0 •• 

• °,n (0 

• 0,n (0 


°ni (0 °n*(0 • 

• o nn (0 




«m(0 ■ 

•• a nn (0 


3.1.57. Omit selecting sign of the entries from the definition of a 
determinant, i.e. consider the following function against the entries 
of the matrix A: 

Pi A ) = j ^2 . 0ii,02j, • • • Onj„» 

where the subscripts f v /„ . . ., /„ run through the whole set of per¬ 
mutations of numbers 1, 2, . . ., n. This function is called the per¬ 
manent. Prove that for both the determinant and permanent, the 
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following properties hold: (a) if all the entries of an arbitrary row of 
the matrix A are multiplied by a number a, then the permanent is 
also multiplied by this number; (b) if all the entries of the i-th row 
of the matrix A are the sums 

a U = bj + c } , 7 = 1,..., n , 

then the permanent of the matrix A equals the sum of the perma¬ 
nents of the two matrices that differ from A only in the i-th row, 
viz., the first having all its entries in this row equal to the numbers 
bj, and the second to the numbers cp, (c) when the matrix is trans¬ 
posed the permanent remains unaltered. 

In contrast to the determinant, however, (d) interchanging the 
rows (or columns) of the matrix leaves the permanent unaltered. 

Construct some examples demonstrating that the permanent may 
be nonzero even if the rows of its matrix are linearly dependent, and 
may equal zero in the case of a matrix with linearly independent rows. 


3.2. Minors, Cofactors and the Laplace Theorem 

The contents of this section are: 

Problems about finding a minor, a complementary minor and a cofactor. 
The adjoint and associated determinants and certain their properties are also 
considered here. 

Examples of the use of the Laplace theorem and some computational 
problems. 

Exercises to use the method of recurrent relations, described in the in¬ 
troduction to the chapter, to evaluate three-diagonal determinants. 

3.2.1. Find, for a determinant of order n: (a) the number of mi¬ 
nors of order k contained in k fixed rows; (b) the number of all mi¬ 
nors of order k. 

3.2.2. Let M be an arbitrary minor of a determinant of order n; 
M' be the complementary minor; and let (—1 ) >M M' be the correspond¬ 
ing cofactor in M (here s M is the sum of the numbers of those rows 
and columns of the determinant which form the minor M). Show 
that the cofactor corresponding to the minor M' equals (—1 ) SM M. 

3.2.3. The minor placed at the intersection of the A-th row and 
the A-th column of a determinant with the same numbers is called 
the principal minor of order k. Find how many principal minors of 
order k there are in a determinant of order n. 

3.2.4*. Find expressions for the coefficients of the polynomial 
/ (f) given by the determinant 


*11+* 

<*1» • 


«« 

«« + * • 


«ni 


'• <*nn-M 
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in terms of the minors of the determinant 
I a n a i2 • • • a l« I 
a 2 i fl S2 ... a 2n 


| a m a ns ■ • • a nn I 

3.2.5. Find the maximum possible number of nonzero minors of 
order k in the first k columns of this almost triangular determinant of 
order n 

a U a u a ia ••• a l. n -1 a in 

a « a sa a 28 • ■ • a *. n-i a sn 

0 a 32 a 33 ... a 3 , n-j a sn 

0 0 0 ... On. n -1 <*nn 

3.2.6. Let D be a determinant of order n {n > 1). The determi¬ 
nant D' obtained from D by replacing each element a tJ with its cofactor 
A t ] is said to be adjoint of D. The determinant D" obtained from D 
by replacing each element a u with its complementary minor M ti is 
said to be associated with D. Prove that D' = D". 

3.2.7. Prove that if a determinant D is symmetric (i.e. each ele¬ 
ment of the determinant D is equal to the one symmetric to it about 
the principal diagonal), then the adjoint determinant D' is also 
symmetric. A similar statement is valid for the associated determi¬ 
nant D". 

3.2.8. Is the following statement valid: If a determinant D is 
skew-symmetric, then the adjoint determinant D' is also skew- 
symmetric? 

3.2.9. * Prove that the determinant, adjoint to the triangular 
determinant of Problem 3.1.8, is of the form 

i4 u A l2 i4 13 ... i4 in 
0 ^21 ^28 • • • ^28 

0 0 A„ ... A 3 n ■ 


|0 0 0 ... A nn \ 

3.2.10. * Find the relation between the value of a triangular de 
terminant of order n and the value of its adjoint. 

3.2.11. * How will the adjoint determinant D' be altered if fora 
given determinant D of order n (a) all elements of the i-th row are 
multiplied by a number a; (b) the i-th and ;-th rows are inter¬ 
changed; (c) the /-th row is added to i-th multiplied by an arbitrary 
number a; (d) the determinant D is transposed. 

3.2.12. Show that the Laplace expansion of a determinant of 
order n by any of its k rows (or coiurans).coincides with its decom¬ 
position by the remaining n —.k rows (or columns). 






3.2 


Minors, Cofactors and Laplace Theorem 


05 


3.2.13. Prove that if, for a determinant of order n all the minors 
of order k (k <. n) are equal to zero, then all minors of an order 
higher than k are also equal to zero. 

3.2.14. Prove that among the minors of order k, made up of the 
first k columns of this quasi-triangular determinant 


a kh “h. I 

o 


only the principal minor can be nonzero. Find the Laplace expansion 
of this determinant over the first k columns. 

3.2.15.* Given that the principal minor of order k, formed by the 
first k columns of a determinant d of order n , is nonzero, and all the 
other minors of order k equal zero, prove that d is of the form indi¬ 
cated in Problem 3.2.14. 

Using the Laplace theorem evaluate the following determinants: 


3.2.16. 


1 0 0-1 

2 3 4 7 

-3 4 5 9 

-4—56 1 


3—152 
2 0 7 0 

— 3 12 0 

5-412 


3.2.18. 


5 62 
0 2 

6 183 

0 3 


— 79 4 

3 0 
201 5 

4 0 


3.2.19. 19 


5 

1 

7 


7 6 8 5 
0 0 2 0 
3 0 4 0 
0 0 0 0 
5 4 6 0 


1 2 3 4 5 

2 12 3 4 
0 2 12 3 
0 0 2 1 2 
0 0 0 2 1 


0 2 0 3 

2 0 3 0 
0 3 0 4 

3 0 4 0 
0 4 0 3 


3.2.22. 




II 

8 

4 

3 


5-0619 
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3.2.23. 12 3 1 2 9 81 3.2.24. 12 —3 7 1 9 ll 


3 4 2 7 5 3 

0 0 5 3 3 1 

0 0 8 5 7 5' 

0 0 0 0 9 7 

0 0 0 0 4 3 

3.2.25. 1 30 94 46 14 2 

0 7 6 9 4 0 

0 0 3 5 0 0 

0 0 2 3 0 0' 

0 5 1 4 3 0 

2 7 47 23 15 1 

3.2.27. Prove that 


1 0 3 0 -4 0 

7 4 9 -1 11 -5 

10-10 1 0 • 
9 -4 11 1 13 2 

4 0 10-1 0 

3.2.26. 210000 
12 10 0 0 
0 12 10 0 
0 0 1 2 10 - 
0 0 0 1 2 1 
0 0 0 0 1 2 




«II 

0 

a, 2 

0 

... a,„ 

0 

0 

*11 

0 

6 12 

... 0 

6|n 

a 2 l 

0 

<2 22 

0 

... a 2 „ 

0 

0 

6 2l 

0 

6; 2 

... 0 

b t n 

flni 

0 

a m 

0 

... 

0 

0 

bni 

0 

'Ojli 

... 0 

b n n 
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Using the Laplace theorem, and having first transformed them 
evaluate the following determinants: 


-8 5 9 5 
-11 7 7 4 


-3—4 6 8 

-2-34 6 


3.2.29. I 9 797 


-9-7 9 7 
- 8-6 8 6 


3.2.31. 


213 186 162 137 
344 157 295 106 
419 418 419 418 
417 416 417 416 



1 2 3 4 5 

4 7 6 7 8 

2 5 9 10 11 

5 9 111 

9 12 3 4 


3.2.34. 


0 11111 
10 112 3 
110 13 6 
1 0 0 2 0 0 
0 1 0 0 3 0 
0 0 1 0 0 4 


2 11113 

12 113 1 

112 3 11 

113 4 11 

13 114 1 

3 11114 


3.2.36. Prove that for the permanents (see Problem 3.1.57), a 
theorem similar to the Laplace is valid, namely if, in a square matrix 
A of order n, k rows (or columns) 1 ^ k ^ n — 1 are fixed, then the 
permanent of the matrix A equals the sum of the products of the 
permanents of all the submatrices of order k placed in these fixed 
rows (or columns) and the permanents of their complementary sub¬ 
matrices (of order n — k). 

Using iterative relations evaluate the following determinants of 
order n: 


5 2 0 ... 0 

3.2.38. 

7 6 0 ... 0 

2 5 2 ... 0 


2 7 6 ... 0 

0 2 5 ... 0 


0 2 7 ... 0 

0 0 0 ... 5 


0 0 0 ... 7 


3.2.37. 
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3 2 0 0 
13 10 
0 2 3 2 
0 0 13 


3.2.40. I 5 3 


0 

0 


5 

0 


...32. . 
...131 . 
....23 .. 


0 0 ... 0 
-4 0 ... 0 

1 —4 ... 0 

5 1.0 


0 0 0 0 
0 0 0 0 


3.2.41. 


0 10 0 
10 10 
0 10 1 


... 0 0 

... 0 0 

... 0 0 


1 -4 
5 1 


0 0 0 0 ... 0 1 
0 0 0 0 ... 1 0 

0 1 0 0 ... 0 01 

— 1 0 1 0 ... 0 o| 

0 —1 0 1 ... 0 0 


0 0 0 0 ... 01 
0 0 0 0 ... —1 ol 


3.2.43. 

2—1 0 ... 0 

3.2.'4. 

12 11 0 ... 0 


-1 2 —1 ... 0 


4 12 9 ... 0 


0 —1 2 ... 0 


0 4 12 ... 0 


000 ... 2 


0 0 0 ... 12 
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3.2.45. Prove the equality: 

I cos a 1 0 ... 0 0 

1 2 cos a 1 ... 0 0 

0 1 2 cos a ... 0 0 


0 0 0 ... 1 2 cos a 


3.2.46. Find the iteration relations between the polynomials of 
the sequence /„ (X), f 1 (X), / 2 (X), (X), where / ? (X) = 1, and 

the polynomial f t (X) (1 ^ i n) is the principal minor of order i 
placed in the upper left-hand corner of the determinant 


X —a, h t 0 ... 0 

c 4 X-a 2 6, ... 0 

0 c, X— a 3 ... 0 


0 0 0 X-a„_, b n 

0 0 0 c n X—«n 


3.3. Determinants and the Volume of a 
Parallelepiped in a Euclidean Space 

In this section some of the properties of determinants and the volumes of 
parallelepipeds in an n-dimensional Euclidean or unitary space are established 
using the natural relationships between them. Thus, the determinant of a 
square matrix of order n is an orientation volume of a parallelepiped generated 
by an ordered set of rows (or columns) for this matrix; the rows (columns) are 
considered here to be vectors of the corresponding arithmetic space, and the 
modulus of the determinant coincides with the volume of the parallelepiped 
(see V. Voyevodin, Linear Algebra, Chapter 4). In particular, this relationship 
makes it possible to extend Hadamara’s inequality to determinants and to 
obtain the related approximations to the values of determinants, and conse¬ 
quently to its volume. We also consider the Gram determinants and find their 
relation to the volumes. Finally, we provide some problems to illustrate the 
stability of an orthogonal determinant and instability of a determinant of 
general form. 

3.3.1. Let a,, a 2 , . . ., a n be an ordered set of rows of a determi¬ 
nant d of order n, these rows being considered as vectors in an n-di- 
mensional arithmetic space; and let b lt b .. b n be the set ob¬ 

tained from a x , a 2 , . . ., a n by the orthogonalization procedure. Prove 
that the determinant d' , whose rows are the vectors b lt b t , . . b n , 
equals the determinant d. 

3.3.2*. Prove that a determinant equals zero if and only if its 
rows (or columns) are linearly dependent. 
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3.3.3. Let d be a determinant of order n 



Using the relationship between the modulus of a determinant and 
the volume of the parallelepiped in an arithmetic space, prove Hada- 
mard’s inequality: 


j=i j=i j=i 

3.3.4. Prove that the equality sign in Hadamard's inequality 
holds if and only if either each pair of the rows of the determinant 
are orthogonal, or all the elements of at least one row equal zero. 
A similar statement holds for the columns of the determinant. 

3.3.5*. Prove that if the modulus of all elements a ti of a deter¬ 
minant of order n is bounded by a number M, \ a lt | ^ M , 
then (a) the modulus of the determinant does not exceed M n n n i 2 ; 
(b) this approximation is achieved for determinants with complex 
entries for any n; (c) for determinants with real entries, this approxi¬ 
mation is achieved if n is a number of the form n = 2 m . 

3.3.6*. Prove that the maximum /„ of the moduli of determinants 
of order n all of whose elements are real numbers from the line seg¬ 
ment [—1, 1] coincides with the maximum g n of the moduli of deter¬ 
minants whose elements only assume the values 1 and —1. 

3.3.7*. Let h n be the maximum of the moduli of determinants of 
order n compiled from units and zeroes, and let g n be determined as 
in Problem 3.3.6. Prove that for the numbers g n and h n , the fol¬ 
lowing relations are valid 

K-l < fen < gn-l < gn < ^K-V 

Note, in particular, that g n is divisible by 2 n_1 . 

3.3.8. Using Hadamard’s inequality and the inequalities proved 
in Problem 3.3.7, prove, for the case of determinants of order 3, 
that (a) h 3 = 2; (b) g 3 = 4. Note that it follows from (b) that the 
approximation of the value of the determinant, indicated in Prob¬ 
lem 3.3.5 (a), is not achieved for a determinant with real coefficients 
of order 3. 

3.3.9*. Strengthen the approximation indicated in Problem 3.3.7 
by proving that 

gn>2g n .^ 

3.3.10*. Find the number g b and a determinant with entries 1 
and —1, equal to g b . Note that the approximation of Problem 3.3.5(a) 
is not achieved for determinants with real entries of order 5. 




3.3 


Determinants and Volume of Parallelepiped 


71 


3.3.11*. Prove that if in the conditions of Problem 3.3.5 all ele¬ 
ments a t] of the determinant d are real and nonnegative, then for 
the modulus of d the approximation is valid: 

|d | < M n 2-" (n + l)<" +1 >/2. 

3.3.12. Reformulate Problems 3.3.5-3.3.11 for the volumes of the 
corresponding parallelepipeds. 

3.3.13. The Gram determinant of a set of vectors x lt x 2 , . . ., x h of 
a Euclidean (or unitary) space is a determinant of the form: 




(*,, X,) (x,. x t ) .. 

'• (*,. *k) 

G(x v .. 

■> **) = 

(X*, X,) (x„ X 4 ) .. 

.. (x„ Xft) 



(Xft.X,) (Xfc, Xj) .. 

(**. Xh) 


The matrix of this determinant is called the Gram matrix of the set 
of vectors x v x 2 , . . ., x h . 

What are the form and value of the Gram determinant if (a) the set 
x lt . . ., x k is orthogonal; (b) the span of the vectors x lt . . ., x t 
(1 ^ l < k) is orthogonal to the span of the vectors x t+1 , . . ., x h . 

3.3.14. How is the Gram determinant of a set of vectors x lt ... 
. . ., x h altered if (a) two vectors, x, and Xj, are interchanged; (b) a 
vector of the set is multiplied by a number a; (c) the vector x t is 
added to the vector Xj premultiplied by the number p. 

Hence deduce that the property of the Gram determinant being 
equal or unequal to zero is maintained during these elementary trans¬ 
formations of the set of vectors i„ . . ., x k . 

3.3.15*. Prove that a set of vectors x lt of a Euclidean 

(or unitary) space is linearly dependent if and only if the Gram 
determinant of this set is equal to zero. 

3.3.16*. A certain principal minor M of order m, m < k, in the 
Gram determinant G \x x , . . ., x fc ) equals zero. Prove that in this 
case any principal minor enclosing the minor M is also equal to zero. 
(A minor M 2 is said to enclose a minor if the matrix of the minor 
M 2 contains the matrix of the minor as a submatrix.) In particu¬ 
lar, the determinant G (x 1 , . . x h ) is also zero. 

3.3.17. Prove that the Gram determinant of a set of vectors 
x lt . . ., x h is unaltered if a vector of this set is replaced by the 
perpendicular drawn from this vector to the span of the other vectors 
in the set. 

3.3.18*. Let x lt . . ., x h be an arbitrary set of vectors of a Eucli¬ 
dean (or unitary) space; and let y lt . . ., y h be the orthogonal set 
obtained from the vectors x lt . . ., x h by the orthogonalization 
process. Prove that 

G (x, -- x k ) = G (y, . y k ) = | Vl | 2 I y t I 2 . .. I y h I 2 . 
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Using this result, establish the relationship between the Gram deter¬ 
minant of the vector set z x , . . ., x h , and the volume of the paralle¬ 
lepiped generated by this set. 

3.3.19. Prove that the Gram determinant G (z x , . . ., x h ) equals 
zero if the set of vectors x„ . . ., x h is linearly dependent and is 
positive if this system is linearly independent. 

3.3.20. Let A be an arbitrary square matrix of order n, either 
real or complex; a u . . a n be the rows of this matrix, regarded as 
vectors of the corresponding arithmetic space; and G (a 1 , . . .,a n ) 
be the Gram determinant of this set (we assume, as usual, that the 
scalar product of the vectors x = (a lt . . ., a„) and y = (P lt . . . 
. . ., P„) is determined by formula (2.2.1) in the space R n , and by the 
formula 

(z, y) = c^p, + . . . + a n | n (3.3.1) 

in the space C n ). Prove that 

| det vl |* = G (a v . . ., a„). 


3.3.21*. Verify that the proof of the properties of the Gram deter¬ 
minant stated in Problems 3.3.13-3.3.19 can be given without the 
use of the Cauchy-Buniakowski inequality, i.e. only with the help of 
the theorems on vector orthogonality. Deduce this inequality from 
the nonnegativeness of the Gram determinant. 

3.3.22. Prove that the element of Ihe Gram determinant with the 
maximum modulus lies on the principal diagonal of this determi¬ 
nant (and if there are several elements of this kind, then at least 
one of them lies on the principal diagonal). 

3.3.23. Prove that the distance from a vector z in a Euclidean 
(or unitary) space to a linear subspace L, spanned by the linearly 
independent set of vectors z lt . . ., z*, can be computed by the 
formula 


p (x, L) = 


■. *») |'/2 
*h) J 


3.3.24. Prove Hadamard's inequality for the Gram determinants 


G (z 1 , • • z„)< | z, | 2 . . . | x h | 2 . 


Show that the equality sign holds here if and only if either each pair 
of the vectors z lt . . ., x h is orthogonal, or at least one of these 
vectors equals zero. 

3.3.25*. Prove the following generalization of Hadamard’s in¬ 
equality for the volumes of parallelepipeds 
V (z x , . . ., x u x l+1 , . . ., z») 

< V (x Jf . . z,)-V (z /+1 , . . ., z„), 

where V (. . .) denotes the volume of the parallelepiped generated by 
the corresponding vector set. 
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Show that the equality sign is valid here if and only if either 
(x t , Xj) = 0, t = 1, . . /,/ = / + 1, .... k, 

or at least one of the subsets x lt . . ., Xi and x t+1 , . . ., x h is linear¬ 
ly dependent. Enunciate the corresponding property for the Gram 
determinants. 

3.3.26. Let x t , . . ., a:*.,, x h be a linearly independent set of 
vectors of a Euclidean (or unitary) space. Prove that for any vector 
z, the following relation between the volumes of parallelepipeds is 
valid 

V(I,. .., X h , 2 ) ^ V(x t . x k _ t , s) 

V(x, . xh) V(r t .• 

Hence deduce the corresponding property for the principal minors 
of the Gram determinant. 

3.3.27*. Leta^, ...,£* be an arbitrary set of vectors. Prove the 
inequality 

.... v(x„.. ., Xj-i, Xj +,, . . ., Xh). 

Explain the geometric sense of this inequality. Formulate a similar 
property for the principal minors of the Gram determinant. 

3.3.28*. Let x lt . . ., x h be an orthonormal set of vectors. Prove 
that for any vector e whose length is less than unity, the following 
inequalities are valid 

1 — |e| (x t , .... ar,_„ x„ x l+l , .... **)<* +|e|; x,-x, + e . 

3.3.29. A determinant is said to be orthogonal if its rows, regard¬ 
ed as vectors in an arithmetic space form an orthonormal set. Re¬ 
formulate the statement of Problem 3.3.28 for orthogonal deter¬ 
minants. 

3.3.30*. Interpreting the modulus of a determinant of order n 
as the volume in an n-dimensional arithmetic space, explain the 
geometric sense of the moduli of the minors of order k (k < n). 

3.3.31. Prove that the modulus of the minors of any order of an 
orthogonal determinant does not exceed unity using (a) Hada- 
mard’s inequality for determinants (see Problem 3.3.3.); (b) a geo¬ 
metric interpretation of the moduli of minors (see Problem 3.3.30). 

Is a similar statement valid for arbitrary determinants whose 
modulus equals unity and which are not orthogonal? 

3.3.32. Show that the following determinant of order n 

II 2 0 ... 0 0 
o l 2 ... o 0 
0 0 1 ... 0 0 


0 0 0 ... 1 2 

0 0 0 ... 0 1 


(3.3.2) 
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can be made equal to zero by a perturbation of a certain element 
whose modulus equals 2 - < n_1) . Find this perturbation. Relate this 
result to the question in the previous problem and give its geometric 
interpretation. 


3.4. Computing the Determinants 
by the Elimination Method 

In the present section we consider various topics related to Gauss elimin¬ 
ation applied to the evaluation of determinants. We provide four groups of 
problems on the following: 

The relations between the elements of determinants, obtained at various 
stages of the reduction to triangular form, and the minors of the original deter¬ 
minant. 

Problems for practising the Gauss method. 

The computational aspects of the method, i.e. the number of arithmetic 
operations, the necessity to control the growth of elements during the reduction 
process, and hence, the use of various tactics whilst interchanging them. 

The application of the Gauss method to the proof of a useful theorem on the 
Kronecker product of determinants and some of its corollaries. 

3.4.1. A determinant with a matrix A was evaluated by the 
Gauss method without interchanging any rows or columns, i.e. the 
pivots at the various stages were the elements in the (1,1), (2, 2), . . . 

. . ., (n — 1, n — 1) positions, respectively. Prove that after the 
( p — l)th stage of this reduction all the minors of order p contained 
in the first p rows of the matrix were unaltered. Show also that these 
minors are unaltered in the subsequent stages of the reduction. 

3.4.2. Let A be a square matrix of order n. The principal minor 
of order r at the intersection of the rows and columns numbered 

1,2, . . ., r is called the leading principal minor of order r of the 
matrix A. Prove that if all leading principal minors of the matrix A 
of orders 1,2, . . ., n — 1 are nonzero, then all the pivots aJ/Vi iP j-i 
employed in the elimination method for the matrix are also nonzero. 
Find an expression for the pivots in terms of the principal minors of 
the matrix A. 

3.4.3*. Prove that if 

i«ifi>;si<M. i- 1. .« 

then the condition indicated in tha previous problem for the matrix 
A of order n is fulfilled. Moreover, the determinant of the matrix 
A, in this case, is not equal to zero either. 

3.4.4*. Prove that for the Gram matrix of a linearly independent 
set of vectors x lt . . ., x h of a Euclidean (or unitary) space, the con¬ 
dition indicated in Problem 3.4.2 is fulfilled. Moreover, all the pi¬ 
vots of this matrix involved in the Gauss elimination are positive 
and do not exceed the maximum entry of the original matrix. 
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3.4.5. Prove that if the determinant of a matrix A is nonzero 
then, by interchanging the rows and columns of this matrix, all 
the leading principal minors can be made to be nonzero. 

3.4.6*. During the process of Gauss elimination for a matrix A, 
no interchanging was necessary. Find expressions for the nonzero 
elements of the />-th row of the matrix .4 (p-1> , obtained after the 
(p — l)th stage, in terms of the original matrix. 

3.4.7. Using the result of Problem 3.4.6 show that if, in a matrix 
A of order n, all the minors of order r -f 1 enclosing the nonzero 
leading principal minor of order r, l^r^n — 1 (the definition 
of an enclosing minor is given in Problem 3.3.16), are equal to zero, 
then the determinant of the matrix A equals zero. 

3.4.8*. Prove that if in a matrix A of order n there is a nonzero 
minor M of order r, 1 ^ r ^ n — 1, such that all its enclosing mi¬ 
nors of order r + 1 equal zero, then the determinant equals zero. 
Note that for the above statement to be valid, it is only necessary 
that the enclosing minors that are situated in the r + 1 rows of the 
matrix A (r of these rows coinciding with the rows forming the mi¬ 
nor M) are equal to zero. 

3.4.9*. Using the Gauss method prove that the relation between 
a determinant d of order n and its adjoint d ', 
d' = d"' 1 , 

established in Problem 3.2.10 for triangular determinants, is valid 
for any determinant d. 

Using the Gauss method, evaluate the following determinants: 

3.4.10. II l 1 II 3.4.11. 11 1 1 11 

12 12 1 ' _1 



113 1 



1 -1 

1 _1 1 



3.4.12. 

0 12 3 


3.4.13. 

1 2 

3 4 




10 12 



3 6 

8 11 




2 10 1 



7 13 

20 26 * 




3 2 10 



31 23 

55 42 



3.4.14. 

1 2 3 

4 

3.4.15 

1 

2 3 4 




3 4 5 

6 


3 

4 5 6 




5 6 7 

8 


5 

6 7 9- 




31 23 55 

42 


31 : 

23 55 42 



3.4.16*. 

30 20 

15 

12 3 

1.4.17* 

. 1/2 1/3 

1/4 

1/5 


20 15 

12 

10 


1/3 1/4 

1/5 

1/6 


105 84 

70 

60 * 


1/4 1/5 

1/6 

1/7 


168 140 

120 

105 


1/5 1,6 

1/7 

1/8 
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3.4.18. 2 1000 4 0.08 

1 3000 -6 0.02 

3 — 2000 2 — 0.02 • 

2 -1000 2 0 

3.4.19. 128 256 384 512 

1/4 3/8 1/8 1/4 

1/64 1/64 1/64 -1/64 ' 

2 0-4 -12 

3.4.20. 1001 1002 1003 1004 

1002 1003 1001 1002 

1001 1001 1001 999 • 

1001 1000 998 999 

3 . 4 . 21 . 1 2 -1 - 0.002 

3 8 0 - 0.004 

2 2 - 4 - 0.003 ’ 

3000 8000 -1000 -6 

3.4.22. 0 2 3 4 5 3.4.23. 1 1 0 0 0 

1 1 2 3 4 1 3 1 0 0 

10123. 16410. 

1 0 0 1 2 1 10 10 5 1 

1 0 0 0 1 1 15 20 15 6 

3.4.24. 1 1 1 1 1 3.4.25. 3 2 0 0 0 

1 2 1 2 1 1 3 2 0 0 

1 1 3 1 1 , 01320. 

12 14 1 0 0 13 2 

1 1 1 1 5 0 0 0 1 3 

3.4.26. 111111 

12 12 12 

113 113 
12 14 12- 

11115 1 

1 2 3 2 1 6 

3.4.27. 1 10 100 1000 10000 100000 

0.1 2 30 400 5000 60000 

0 0.1 3 60 1000 15000 

0 0 0.1 4 100 2000 . 

0 0 0 0.1 5 150 

0 0 0 0 0.1 6 
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3.4.28. Evaluate the polynomial / ( t) given by the determinant 

3— 1 1 0 0 0 0 

— 1 3—1 10 0 0 

0 — 1 3— * 1 0 0 

0 0—1 3-1 1 0 

0 0 0 -1 3-1 1 

0 0 0 0 —1 3-1 

when 1 = 2. 

3.4.29. Find the number of multiplication and division opera¬ 
tions necessary for evaluating a determinant of order n by the Gauss 
method. Compare this number with the number of multiplication 
operations when evaluating a determinant by the definition only. 

3.4.30. Assuming that in Gaussian elimination no interchange 
occurred, find the number of multiplications and divisions necessary 
to evaluate (a) an almost triangular determinant of order n 

a t\ a ii a 23 ••• °2. n-2 “2. n-1 °2n 
0 a 3t a 33 ... a 3 , n -t “a. n-i “an 


0 0 0 ... fln-i, n-t “n-i.n-i «n-i,n 

0 0 0 ... 0 “n. n-i Onn 


(b) a tridiagonal determinant of order n 
o x b t 0 ... 0 0 

Cj ij i, ... 0 0 

0 c 3 a 3 ... 0 0 


0 0 0 ... On-1 bn 

0 0 0 ... c„ a„ 


3.4.31. Let it be required to evaluate an n-order determinant 
d n known to be nonzero, and its enclosing determinant d n+1 of order 
n + 1, i.e. 



lb, b 2 ... b n e 


Organize the sequence of computations using Gaussian elimination 
so that for evaluating both determinants d„ and d n+l , there may be 
required the same number of multiplications and divisions as for 
evaluating only the determinant of order n + 1. 
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3.4.32. It is required to evaluate k determinants of order n which 
differ from each other only in the last column. Given that all the 
determinants are nonzero, what is the sequence of computations 
using the Gauss method in which the evaluation of all k determi¬ 
nants requires only 0 ( kn 2 ) more multiplications than the number of 
operations necessary to evaluate one determinant of order n. 

3.4.33*. Find a method to evaluate a determinant of order n of 
the form 


a ii a 23 “u 

0 a 33 a 34 

0 0 a u 



°n-i, i 0 0 0 On-i, n-i ®n-i. n 

On i o n2 a ns a ?u ••• <*n, n-i °nn I 


(where the diagonal elements a 22 , . . a n are nonzero) such 
that the number of operations is a second degree polynomial in n 
(and not third degree as would be the case for the Gauss method when 
applied to determinants in a general form). 

3.4.34. Consider the set D„ of determinants of order n that fulfil 
the following conditions: (a) the modulus of all the elements of the 
determinants is bounded by unity; (b) there is an element whose mo¬ 
dulus equals unity; (c) all the leading principal minors arc nonzero. 

The last condition makes it possible to use the Gauss method to 
evaluate a determinant from the set D n without any interchange 
(sec Problem 3.4.2). Prove, however, that if k is any integer from 
the set 1, 2, . . ., n — 1, and N is any positive number, then there 
is a determinant from the set D„ such that in the matrix obtained 
after k stages of the Gauss method without any interchange, there 
may be found an element a)** whose modulus is greater than the 
number N. Thus, whatever the word size used by a computer is, 
there exists a determinant from the set D„ whose evaluation by Gaus¬ 
sian elimination will lead to overflow. 

3.4.35*. Consider the following modification of the Gauss meth¬ 
od intended to avoid the overflow indicated in Problem 3.4.34. 
After completing k stages of the reduction to triangular form, 
the element with the greatest modulus out of the elements 
oi+i,Aj-i a;!+ 2 .ft+i, . • .,' is chosen as the pivot of the 

(k + l)th stage. Let it be an element a)?A +1 , / > k + 1. Then the 
rows k + 1 and j are interchanged so that this element is positioned 
at (k -f- 1, k + 1). Then the customary Gaussian transformations are 
performed for the (k + l)th stage. This modification is called the 
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elimination method with the choice of a pivot in a column (or par¬ 
tial pivoting). Prove that during this procedure (a) if all elements 
flft+i.A+n ai+ 2 .h+i. • • • » fln.ji +1 of the pivotal column are zeroes, 
then the original determinant is also equal to zero; (b) for any posi¬ 
tion ( i , j) 

|a<5 +, )|<2max |a<*>|; 

(c) for a determinant of order n, the modulus of all the elements 
obtained in the process of the reduction to triangular form is not 
more than 2" _1 times as great as the maximum element in the ori¬ 
ginal determinant. 

3.4.36*. Construct an example to support the probability that 
the maximum modulus of elements will grow to the estimated value 
indicated in Problem 3.4.35 (c), during the reduction to the triangu¬ 
lar form using the Gauss method with partial pivoting. 

3.4.37. Prove that whilst applying the Gauss method with partial 
pivoting (a) the maximum modulus of the elements of an almost 
triangular determinant of order n will not increase more than n 
times; (b) the growth of the maximum modulus of the elements of a 
tridiagonal determinant of order n, in the process of the reduction, is 
not more than twofold, i.e. 

max|a£>|<2max |a r ,|, —1. 

3.4.38. It follows from Problem 3.4.36 that even faster growth 
of the maximum modulus of the elements is possible using the Gauss 
method with partial pivoting. As a consequence, a computer may, 
once again, overflow during the computation of a determinant of a 
sufficiently high order. Thus, another modification of the Gauss 
method can be applied: the pivot of the (k + l)th stage is chosen to 
be the element with the greatest modulus out of the submatrix of 
order n — k situated in the lower right-hand corner of the matrix 
-4<*> after the previous k stages. The rows and columns having in¬ 
dices greater than k are interchanged so that the element with the 
maximum modulus is positioned at (k -j- 1, k + 1). The (k + l)th 
stage of the Gauss method is then performed as usual. This modifica¬ 
tion is termed the Gauss method with complete pivoting. Prove that 
for the Gauss method with complete pivoting, the modulus of the 
pivot of the (k -f l)th stage is not more than twice as great as the 
modulus of the pivot of the fc-th stage. Is a similar statement valid 
for the Gauss method with the partial pivoting? 

3.4.39*. There exists a hypothesis that for the Gauss method 
with the complete pivoting, the growth of the maximum modulus 
of the elements of a determinant of order n does not exceed n. Using 
the result of Problem 3.3.8, prove this hypothesis for n = 3. 
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3.4.40. Deduce from the result of the previous problem that whilst 
applying the Gauss method with complete pivoting (a) the growth of 
the maximum modulus does not exceed 6 in the case of real matrices 
of order 4; (b) the growth of the maximum modulus does not exceed 9 
in the case of real matrices of order 5. 

3.4.41*. The following determinant of order mn 



. . a.nft,, 

a u b l4 

... a |n^i 2 


• •• a,n&im 

a ni&n 

• ■ a„„b n 

«n l h 12 

... a„„b li 

dnjhj m 

• ■ • »nnhm 

Oil&si 

.. a inf>n 

a 11622 

■ • «i nl’tt ■■■ 

a |, />2 m 

• - - <>in b tm 

Oni^ji 

a nn b tl a nl b 12 

• ■ ■ Onnb t j 

fl n i tam 

a nnbtm 

Oil&mi • 

a inl>mi On^nii 

• ■ "l" b mt ••• 

« M b mm 

Oin^mm 

a ni ft ml . 

•• Onn&mi a ni b mi 

... a nn b m j ... 

Oni b mm 

Onnb mm 


is called the Kronecker product of the determinant 


and the determinant 


<**i a n 
Oni a„ t 


of order n and m, respectively. Thus, the matrix of the determinant 
D consists of m 2 blocks of order n. These blocks are obtained from the 
matrix A by multiplying all its elements by b 12 , . . b lm , 

bn, b 22 . b 2m , .... b mv b mi , . . ., b mm , respectively. By 

means of the Gauss method, prove that 


D = (det A) m (det B) n . 


3.4.42. Prove that the Kronecker product of two orthogonal deter¬ 
minants, d of order n and d' of order m, is an orthogonal determinant 
of order mn. 

3.4.43. Find the relation between the determinant of a matrix of 
order n and determinants of matrices of order 2n arranged as follows: 


(a) 

CM) 

(b) 

(-i- 

(c) 

/2i4 3A\ 

{ A2A)' 

(d) 

/ A 3i4\ 
\2.4 5a) 
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Systems of Linear Equations 


4.0. Terminology and General Notes 
A rectangular number table consisting of m rows and n columns, 



is called a rectangular matrix of order m X n (or an m X n matrix). 
It is said to be real or complex depending on whether the elements 
a t / of this matrix are real or complex. 

A minor of order k is defined for a rectangular matrix, as in the 
particular case of a square matrix (see Sec. 3.0), assuming that 
k < min (m, n). The minor is designated in the same way, i.e. as 



The highest order r of the minors of a matrix A that are nonzero is 
called the rank of this matrix, and any nonzero minor of order r is 
termed the basis minor of the matrix A. If all elements of a matrix 
are zeroes (the zero matrix), then its rank is defined to be zero. 

If the rows of a matrix A are considered as n-dimensional vectors 
and its columns as m-dimensional vectors, then the rank of the set 
of rows and the rank of the set of columns are both equal to the rank 
of the matrix A. Hence, the rank of the transposed matrix A T , order 
n X m (see Sec. 3.0), coincides with the rank of A. 

Let x 0 be a fixed vector and L a subspace in an n-dimensional lin¬ 
ear space V. The set P of all vectors of the form 
x = x 0 + y, y £L, 

is called the plane obtained by translation of the subspace L by the 
vector x 0 and denoted by x 0 + L, x 0 being termed the translation 
vector, and L the directional subspace of the plane P. 

If the subspace L is represented as the span L (q 2 , q 2 , . . ., g ft ) 
then a parametric equation of the plane P can be formed 
x = x 0 + ttfi + + • • • + t h q h , 

where the parameters t lt t 2 , .... t h assume arbitrary values. 


e-oei9 




82_ Systems of Linear Equations _ Ch. 4 

It can be shown (see 4.2.1) that for a given plane, the directional 
subspace is defined uniquely. Thus, any plane can have a dimension 
equal to that of its directional subspace. Thus, a plane of dimension 1 
is called a straight line and a plane of dimension (n — 1) is termed a 
hyperplane. 

The planes P x = x x + L x and P 2 = x 2 + L 2 are called parallel 
if either L x c= L 2 or L 2 cz L v 

Let us list some other definitions and results regarding systems of 
linear equations (the systems are also considered in Sec. 1.0). 

A system of linear equations is called homogeneous if the right-hand 
sides of all equations of this system equal zero and nonhomogeneous 
otherwise. 

A matrix A, made up of the coefficients of the unknowns, is called 
the coefficient matrix of the given system of equations. If the column 
of the right-hand sides of this system is ascribed to A then the so- 
called augmented matrix A of the system is obtained. 

Let the number of the unknowns in a system of equations be equal 
to the number of the equations. Then the coefficient matrix A of the 
system is a square matrix and the condition det A =^= 0 stipulates 
whether the system is consistent or determinate. A unique solution 
x v . . ., x„ can be found by Cramer's formulae 



where A t is the matrix obtained from A by replacing the i-tli co¬ 
lumn with the column of the right-hand sides. 

Two remarks about the problems of this chapter. A number of 
computational problems are given in Sec. 4.2 concerning determi¬ 
nation of the mutual disposition of planes in a linear space. These 
problems, including those on finding the rank of a given system of 
vectors, intersection of two spans, etc., can be solved by the methods 
of Chapter 1. 

As it is shown in Sec. 4.5, the solution set of a nonhomogeneous 
system of linear equations can be considered to be a plane in an arith¬ 
metic space. If the scalar product can be defined in a space, then 
among the vectors of any plane there exists a unique vector, ortho¬ 
gonal to the directional subspace of this plane (see Problem 4.3.11). 
It is called the normal vector, and the corresponding solution of the 
system of linear equations is called the normal solution. This con¬ 
cept is used, for example, in Problem 4.5.36. 


4.1. The Rank of a Matrix 

In this section we provide a number of problems illustrating various defini¬ 
tions of the rank of a matrix and their applications to finding the rank of con¬ 
crete matrices. 



4.1 


Rank of a Matrix 


4.1.1. Prove that in any r linearly independent rows (or columns) 
of a matrix, there is a nonzero minor of order r. 

4.1.2*. In a rectangular m X n matrix A (m~^n) there is a 
nonzero minor of order n — 1, but all its enclosing minors of order n 
are zero. Prove that all the minors of order n of the matrix A equal 
zero, and hence the rank of A equals n — 1. 

4.1.3*. In a matrix A there is a nonzero minor M of order r but 
all the enclosing M minors are zero. Prove that the rank of A 
equals r. 

4.1.4. What can be said of an m X n matrix ( m > n) of rank 
n if it has only one basic minor? 

4.1.5*. What can be said of an arbitrary m X n matrix if it has 
only one basic minor? 

4.1.6*. Prove that the minor of order r situated at the intersec¬ 
tion of any r linearly independent rows and r linearly independent 
columns is nonzero. 

4.1.7. A square matrix A is said to be symmetric if a tJ = a 1x for 
any i, j. Prove that the rank of a symmetric matrix equals the highest 
order of the nonzero principal minors of this matrix. 

4.1.8. Show that the statement of Problem 4.1.7 is also valid for 
a complex Hermitian matrix A , i.e. the matrix in which a l} *=~a }l 
for any i, j. 

4.1.9*. Prove that the rank of an arbitrary set of vectors in a 
Euclidean (or unitary) space equals the rank of the Gram matrix of 
this system. 

4.1.10. A square matrix A is said to be skew-symmetric if a t) = 
= — a }i for any i, j. Prove that the rank of a skew-symmetric matrix 
equals the highest order of the nonzero principal minors of this 
matrix. 

4.1.11. Prove that the rank of a skew-symmetric matrix is an 
even integer. 

4.1.12. The determinant of a square matrix of order n is nonzero. 
Prove that for any r, l^r^re — 1, the leading principal minor 
of order r of this matrix may be made nonzero by interchanging only 
its rows. 

4.1.13. Prove that all the leading principal minors of a square 
matrix with a nonzero determinant may be made nonzero by inter¬ 
changing only its rows. 

4.1.14. The rank of an m X n matrix A equals 1. Prove that there 
are numbers b u . . ., b m and c t , . . ., c n such that 

a tj = b t Cj 

for any i, j. Are these numbers uniquely determined? 

4.1.15. The rows of an m X n matrix A, considered as vectors in 
an n-dimensional arithmetic space, are orthogonal. Moreover, in 
each row there is at least one nonzero element. Prove that n^ m. 
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4.1.16. Prove that the rank of a matrix A of the form 



equals the sum of the ranks of the submatrices A n and A 22 (0 des¬ 
ignates zero submatrices of the corresponding order). 

4.1.17. Does the following statement hold “the rank of a matrix 
A of the form 



is always equal to the sum of the ranks of the submatrices A u and 
A **”? 

4.1.18. How can the rank of matrix alter if the value of one of its 
elements is altered? 

4.1.19. How can the rank of a matrix alter if the elements of 
only one row are altered? of k rows? 

4.1.20*. Prove that in an re X re matrix of order r, there are k 
elements such that however small a change in their absolute value 
is, it increases the rank of the matrix to r + k, 1 ^ k ^ re — r. 

4.1.21. Indicate the possible values of the rank of a matrix of the 
form 



4.1.22. Prove that in a square re X re matrix with a nonzero de¬ 
terminant, the rank of any square submatrix of order re — 1 is not 
less than re — 2. 

4.1.23. Prove that the two systems of vectors in the arithmetic 
space 

x i = ( a n» • • •* • • •» a l}> • ’ •» a ln)» 

X i = ( a 2H • • •• ®2<» • • •» a ib • ' M ®2n). 


x h = ( a ftl* • • •> a hh • • •> a hjt • • m a hn) 

and 

Hi = ( a ll* • • •> a lb • • •> ®U> • • •* ®ln)t 
Vi = (®21. • • •. ®2J. • • •» ®2 h • • •» ®2n), 


Hh ~ ( a hv • • '* a hjt • • •» a hti • • •* a hn) 
have the same rank. 
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4.1.24. Prove that the dimension of the span generated by a set of 
vectors x lt . . x h equals the rank of the matrix made up from their 
coordinates in any basis for the space. 

4.1.25. Prove that a vector b belongs to the span of x lf . . ., x k 
if and only if the rank of the matrix, made up from the coordinates 
of the vectors x lf . . x h in some basis for the space, equals the 
rank of the augmented matrix made up from the coordinates in the 
same basis of the vectors ij, . . x k , b. 

4.1.26. Prove that the elementary row (or column) transforma¬ 
tions (see Problem 1.2.17) of a matrix do not alter its rank. 

4.1.27. Prove that any m X n matrix can be reduced, by ele¬ 
mentary transformations of its rows and columns, to the form 



where a u , a it , .... a rr are nonzero, and r equals the rank of the 
original matrix. Compare this statement with that of Problem 1.2.18. 
Evaluate the rank of the following matrices: 


4.1.28. II37 259 481 

407 || 

4.1.29. || 2 5 

1 4 31| 

19 133 247 

209 

-3 1 

2 ° 1 

|| 25 175 325 

275 || 

4 1 

6 -1 -1 



11-2 3 

0 4 —91| 

4.1.30*. [1241 381 

273 

“ 165 II 


134 -987 

562 

213 • 


| 702 225 

—1111 

49 II 


4.1.31. | -3 2 0 

1 

4 II 


—1 5 2 

3 

5 



6 -12 3 —7 —8 ' 

—3 7 9 4 15 I 

4.1.32. -5 3 -4 0 3 -4 

4 0 0 —1 3 0 

—31 0 20 0 

2 0 0 -3 0 4 

—10 2 40 0 

4.1.33. 9 -12 3 -4 12 —16 

—15 21 -5 7 -20 28 

18 -24 6 -8 15 —20 ’ 

—30 42 —10 14 —25 35 
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4.1.34. Find the dimension of the span generated by the set of 
vectors x x = (73, —51, 13, 42, 15), x 2 = (44, -32, 5, 25, 3), x 3 = 
= (76, -52, 16, 44, 18), x 4 = (-37, 27, -4, -21, -2). 

4.1.35. A linear space L is spanned by the vectors x x = (2, 4, 8, 
-4, 7), x 2 = (4, -2, -1, 3, 1), x 3 = (3, 5, 2, -2, 4), x 4 = (-5, 1, 
7, -6, 2). 

Do the vectors 

(a) = (6, 18, 1, -9, 8); 

(b) 6 2 = (6, 18, 1, -9 + e, 8); 

(c) b 3 = (6, 18, 1, —9, 8 + e) 

belong to this subspace? Here e is any nonzero number. 

4.1.36*. Prove that the rank of a It X n matrix A of the form 

II1 a, a* ... a” -1 || 

1 a, a\ ... a%~ 1 


|| 1 a* al ... aj" 1 | 

is equal to k, where k < n and a lt a 2 , . . ., a h are different numbers. 

4.2. Planes in a Linear Space 

Most of the problems in the present section concern the following two topics: 
the determination of a plane and its dimension in a linear space; and the mutual 
disposition of planes. 

At the end of the section we state some of the relationships between planes 
of an arbitrary dimension and hyperplanes. 

4.2.1. Prove that the two planes P x = x t + L> 1 and P 2 = x 2 + 
+ L 2 coincide if and only if L x = L 2 and x x — x 2 £ L v Hence the 
direction subspace of any plane is uniquely determined. 

4.2.2. Deduce from the result of the previous problem that for 
any plane any of its vectors can be chosen to be the translation 
vector. 

4.2.3. Prove that if vectors x x and x 2 belong to the plane P = 
= x 0 + L, then x 4 — x 2 6 Conversely, if x 2 6 P and x 4 — x 2 6 
£ L then x 2 £ P. 

4.2.4. Prove that the plane P = x 0 + L is a subspace if and only 
if Xq 6 L- 

4.2.5. Prove that for the plane P = x 0 + L to be a subspace, it is 
necessary and sufficient that the sum of any vectors x 4 and x 2 should 
belong to L. 

4.2.6. Prove that the intersection of the plane P = x 0 + L with 
any subspace, complementary to L, consists of only one vector. 

4.2.7. What represents a plane of zero dimension? 
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4.2.8. What represents a plane of dimension n in an n-dimensional 
linear space V? 

4.2.9. Prove that in the space of polynomials of degree ^ n, the 
set of polynomials f (t) satisfying the condition / (a) = b, where a 
and b are fixed numbers, is a plane. Find the dimension of this plane. 

4.2.10. Prove that in a plane of dimension k , not a subspace, a 
linearly independent set consisting of k +1 vectors can be found. 

4.2.11. Prove that in a plane of dimension k, any set consisting 
of k + 2 vectors is linearly dependent. 

4.2.12. Prove that for any k + 1 linearly independent vectors, 
there exists, and is unique, a plane of dimension k containing these 
vectors. 

4.2.13. Prove that the plane of dimension k containing the lin¬ 

early independent vectors x 0 , x lt . . ., x h can be described by the 
set of all the linear combinations a 0 x 0 + a h x h sa¬ 
tisfying the condition oc 0 + 4- ... + a h = 1. 

4.2.14. Prove that if the intersection of two planes P x = x 2 -+- 
4- and P 2 = x 2 + L z is nonempty, then it is a plane with the 
direction subspace Lx (1 L z . 

4.2.15. We define the sum Pi + P z of the planes P t = x 2 + Lx 
and P 2 = x 2 + L 2 to be the set of all vectors of the form z 2 + z 2 
where 6 P it z 2 6 Pi- Prove that the sum of the planes P 2 and P i 
is also a plane. Find its directional subspace. 

4.2.16. We define the product kP of the plane P = x 0 -f L by a 
number k to be the set of all vectors of the form kz where z £ P. Prove 
that the product of the plane P by the number k is also a plane. 
Find its direction subspace. 

4.2.17. A subspace L is fixed in a linear space V. Is the set M 
of all planes in the space under the operations of addition and mul¬ 
tiplication by a number defined in Problems 4.2.15 and 4.2.16 a 
linear space? 

4.2.18. Alter the definition for the multiplication of a plane by 
a number so that the set M of Problem 4.2.17 may become a linear 
space. Indicate the zero element of this space. (The obtained space M 
is called a factor-space of the space V by the space L). 

4.2.19. Let L be a /c-dimensional subspace of an n-dimensional 
space V in the context of Problem 4.2.18. What is the dimension of 
the space Ml 

4.2.20. Given a plane x = x 0 4- txPx + tiPt where x 0 = (2, 3, —1, 

1). Pi — (3. —1. 1, —1. 1), Pi — (—1, 1, 1, 1, —1), determine 

whether the vectors z = (1, 6, 4, 4, —2) and v = (1, 6, 5, 4, —2) 
belong to this plane. 

4.2.21. Prove that if a straight line has two vectors in common 
with a plane then it is contained in this plane. 

4.2.22. State the mutual disposition of the plane P = x 0 + L, 
where x 0 = (1, 0, 0, 1), and L is spanned by the vectors = (5, 2, 
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—3, 1), y 2 = (4, 1, —1, 0), y s = (—1, 2, —5, 3) and the straight 
lines 

(a) x= x x + tq v x t = (3, 1, -4, 1), q t = (-1, 1, 2, 1); 

(b) x = x 2 + tq 2 , x 2 = (3, 0, -4, 1), q 2 = (-1, 1, 2, 1); 

(c) x = x 3 + tq 3 , x 3 = (-2, 0, -1, 2), q 3 = (1, 1, -2, 1). 

4.2.23. Prove that the straight lines x = x x + tq x and x = x 2 4- 

+ tq 2 , where x x = (9, 3, 6, 15, -3), q x = (7, -4, 11, 13, -5), x 2 = 
= (—7, 2, —6, —5, 3), q 2 = (2, 9, —10, —6, 4), intersect. Find 
their intersection. Indicate the plane of dimension 2 in which these 
straight lines lie. 

4.2.24*. Prove that the straight lines x = x x + tq x and x = x 2 + 
+ tq 2 where x x = (8, 2, 5, 15, —3), q x — (7, —4, 11, 13, —5), x 2 = 

= (—7, 2, —6, —5, 3), q 2 = (2, 9, —10, —6, 4), do not meet. Con¬ 

struct a plane of dimension 3 that contains them both. 

Determine the mutual disposition of the planes P y = x 0 + t- i p l + 
+ fjsPj and P 2 = y 0 + hq x + t 2 q 2 : 

4.2.25. x 0 = (3, 1, 2, 0, 1), Pl = (2, -6, 3, 1, -6), 

y 0 = (1, 0, 1, 1, 0), ?1 = (-1, 1, -1, 0, 1), 

p t = (0, 5, -2, -1, 6), 

q 2 = (-1, 3, -1, -1, 2). 

4.2.26. x 0 = (7, -4, 0, 3, 2), Pl = (-1, 1, 1, 1, 1), 

y 0 = (6, -5, -1, 2, 3), q t = (1, 1, -1, 1,1), 

p 2 = (1, -1, 1, 1, 1), 

q 2 = (1, 1, 1, -1, 1). 

4.2.27. Xq = (2, -3, 1, 5, 0), p x = (3, -2, 1, 0, 1), 

y 0 = (0, -1, 0, 4, 1), g, = (1, 2, 4, 0, -2), 

p 2 = (_1, 5, -2, 0, 3), 

q 2 = (6, 3, 4, 0, 3). 

4.2.28. * 0 = (-3, -2, 1, -1, 2), Pl = (1, -1, 1, 1, 3), 

y q = (-1, 0, 3, 3, 8), q x = (1, 1, -3, -3, 1), 

p 2 = (-1, 2, 1, 2, -2), 

|g 2 = (0, 1, 2, 3, 1). 

4.2.29. Xq = (1, 2, 0, 2, 1), p x = (5, -2, 6, 1, -4), 

y 0 = (1, 2, 1, 2, 1), 9l = (1, -4, 0, 1, -6), 

p 2 = (2, 1, 3, 0, 1), 

g 2 = (-3, 3, -3, -1, 5). 
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4.2.30. x 0 = (4, 1, 10, -3, 5), Pl = (2, 1, 3, 0, 1), 

y 0 = (-3, 2, 1, -4, 8), g x = (3, -3, 3, 1, -5), 

Pt = (1, ~4. 0, 1, -6), 

9* = (5, -2, 6, 1, -4). 


4.2.31. Prove that if a straight line x = x 0 -f tq and a hyperplane 
n = y 0 + L do not meet, then q £ L. 

4.2.32. Prove that if the hyperplanes n 2 = x 0 + L x and n 2 = 
= y 0 + L 2 do not intersect then L 2 — L 2 . 

4.2.33*. Prove that if the intersection of hyperplanes n lt ... 
. . ., jtft of an n-dimensional space is nonempty, then it is a plane 
whose dimension is not less than n — k. 

4.2.34*. Prove that any A:-dimensional plane can be defined, in 
an n-dimensional space, as the intersection of n — A: hyperplanes. 


4.3. Planes in a Euclidean Space 

Various techniques for representing hyperplanes in a Euclidean space are 
discussed, and a one-to-one correspondence between planes and systems ol linear 
equations is established. Then we introduce the notion of a normal vector to 
a plane and consider certain geometric problems related to the determination of 
distance. In conclusion, we consider it important to note that the description of 
planes by systems of linear equations obtained here for the orthonormal bases of 
a Euclidean space, actually holds for any basis of a linear space. 

4.3.1*. Prove that the set of all vectors of a Euclidean (unitary) 
space E satisfying the condition ( n, x) = b where n is a fixed non¬ 
zero vector and b is a given number, is a hyperplane of this space. 
In what case will this hyperplane be a subspace? 

4.3.2. Show that the hyperplane described by the condition 
(n, x) = b can be also described by the condition ( n , x — x 0 ) = 0, 
where x 0 is an arbitrary vector of this hyperplane. 

4.3.3*. Prove that any hyperplane of a Euclidean space can be 
determined by a condition of the form (n, x) = b. 

4.3.4. Prove that if the conditions (n lt x) = b 1 and (ra 2 , x) = b 9 
determine one and the same hyperplane, then for a certain nonzero 
number a, n 1 = a n 2 and b 2 = ab 2 . 

4.3.5. The scalar product for the space of polynomials of degree 
O is defined by formula (2.3.1). Describe the hyperplane, given by 
the condition / ( c) = d, by a relation of the form (n, /) = b. Indicate 
the corresponding polynomial n ( t ). 

4.3.6. Can an arbitrary hyperplane of the space of polynomials 
(see the previous problem) be described by a condition of the form 
/ (c)= d? 
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4.3.7. Prove that any hyperplane can be described, with respect 
to any orthonormal basis, by an equation of the first degree 
A&! + A 2 a 2 + ... + A n a n = b 
in the coordinates a lt a 2 , ■ . ., a n of vectors of this hyperplane. 

4.3.8*. Prove that if the intersection of hyperplanes in an re-di¬ 
mensional space 

(re„ x) = b lt 

(n*. x) = 


(n k , x) = b k 

is nonempty, then it represents a plane whose dimension equals 
n — r where r is the rank of the set of vectors re,, . . ., re h . 

4.3.9. An orthonormal basis e v ...,«„ is fixed for a Euclidean 
{unitary) space. Prove that (a) if 

a ll®l + G|2®2+ • • • + a ln a n = &l> 
a 2l a l + ®22 a 2 + • • • + ®2n®n = &2> 


aml«l + «m2«2 + • • • + «mna B = 

is an arbitrary consistent system of linear equations in re unknowns, 
then the set of vectors z, whose coordinates in the basis e lt . . ., e„ 
satisfy this system, is a plane of the space E. The dimension of this 
plane equals re — r where r is the rank of the matrix 
I <»ii o,* ... a,„ 1 
a tl a M ... a 2n | . 


I a m i a mt • • • Omn | 

(b) any plane P in the space E can be described by a certain sys¬ 
tem of linear equations. This means that a vector z belongs to the 
plane P if and only if its coordinates with respect to the basis e lt . . . 
. . ., e n satisfy the given system. If r is the dimension of the plane 
P, then any system describing this plane consists of at least re — r 
equations, and there exists a system containing precisely re — r 
equations. 

4.3.10. Find a system of linear equations describing the plane 
P = x 0 + L where x 0 = (1, 1, 1, 1) and L is spanned by the vectors 
y, = (1, 3, 0, 2), y 2 = (3, 7, -1, 2), y 3 = (2, 4, -1, 0). 

4.3.11. Prove that among the vectors in any plane P there is a 
unique vector z 0 , orthogonal to the directional subspace of this 
plane. The vector z„ is called the normal vector of the plane P. 

4.3.12. Show that of all vectors in a plane P the normal vector 
z 0 has the least length. 
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4.3.13. Show that the normal vector z 0 of a plane P equals the 
perpendicular drawn from an arbitrary vector of this plane to the 
directional subspace. 

4.3.14. Find the normal vector z 0 of the hyperplane given by the 
condition ( n, x) = b. 

4.3.15. Let z 0 be the normal vector of a plane P (not coincident 
with the whole space). Prove that the plane P is contained in the 
hyperplane (z 0l x) = (z 0l z 0 ). 

4.3.16. Find for the space of polynomials of degree with the 
scalar product (2.3.1) the normal vector of a plane defined by the 
conditions / (0) = 1, / (1) = 1. 

4.3.17. We define the distance between a vector x and the plane P = 
= x 0 -f L to be the number 


p (x, P)= inf p(x, u). 

u£P 

Prove that the distance p (x, P) is equal to the length of the perpen¬ 
dicular drawn from the vector x — x 0 to the subspace L. 

4.3.18. A subspace L is generated by a linearly independent set 
of vectors y v . . ., y h . With the use of the result of Problem 4.3.17 
and the Gram determinant properties, prove that the distance from 
the vector x to the plane P = x 0 + L is equal to 

p (J, P) = ( Hi-kj-LLLLHh: «-*„> I* 7 *, 


G(y„ 


. Vh) 


4.3.19. Find the distance from the vector x = (5, 3, —1, —1) 
to the plane P = x 0 + L where x 0 = (0, 0, —3, 6) and L is spanned 
by the set of vectors y, = (1, 0, 2, —2), y t — (0, 1, 2, 0), y 3 = 
= (2, 1, 6, -4). 

4.3.20. A number 


p(P,, P 2 )= inf p(u„ u 2 )] 
U16P1. ui€Pj 


is called the distance between two planes P x = x 1 + L x and P 2 = 
= x 2 + L 2 . Prove that the distance p (P lt P 2 ) is equal to the length 
of the perpendicular drawn from the vector x 1 — x 2 to the subspace 
L — L l L 2 . 

4.3.21. Prove that the square of the distance between the straight 
lines l x = ij + tq 1 and l 2 = x 2 + tq 2 equals 


(a) 


P 2 dr /*) = 


G(<?i. q t , x x — x t ) 
G (<h, q t ) 


if the straight lines ^ and l 2 are not parallel; 


(b) 

if the straight lines l x and l 2 are parallel. 
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Find the distance between the straight lines l x = x x + tq x and 

12 — 3?2 “1“ ^2* 

4.3.22. x, = (5, 2, 0, 3), q x = (1, 2, -4, 1); x 2 = (3, -1, 3, 1), 
g 2 = (1, 0, -1, 0). 

4.3.23. x, = (5, 4, 3, 2), q x = (1, 1, -1, -1); x 2 = (2, 1, 4, 3), 
g 2 = (—3, —3, 3, 3). 

Find the distance between the planes P x = x 0 + t x p x + £ 2 p 2 and 
^2 = l/o + *i?i + hq*- 

4.3.24. x 0 = (89, 37, 111, 13, 54), p x = (1, 1, 0, -1, -1), 

y 0 = (42, -16, -39, 71, 3), q x = (1, 1, 0, 1, 1), 

p 2 = (1, -1, 0, -1, 1), 
g 2 = (1, -1, 0, 1, -1). 

4.3.25. x 0 = (5, 0, -1, 9, 3), p x = (1, 1, 0, -1, -1), 

y 0 = (3, 2, -4, 7, 5), q x = (1, 1, 0, 1, 1), 

p 2 = (1, -1, 0, -1, 1), 

g 2 = (0, 3, 0, 1, -2). 

4.3.26. x 0 = (4, -2, 2, 2, 0), p x = (1, 2, 2, -1, 1), 

y 0 = (-1, 1, -1, 0, 2), q x = (8, 7, -2, 1, -1), 

p 2 = (2, 1, -2, 1, -1), 

g 2 = (-5, -4, 2, - 1 , 1 ). 

4.3.27. Prove that with respect to any basis for a linear space, 
any hyperplane can be described by a first degree equation in the 
vector coordinates of the hyperplane (cf. Problem 4.3.7). 

4.3.28. Prove that with respect to any basis of a linear space, any 
plane of dimension r can be described by a system of n — r linear 
equations in the vector coordinates of the plane. 

4.3.29. Let{ P be a certain plane in a linear space, not being a 
subspace, and x an arbitrary vector in this plane. Show that the 
scalar product can be defined for the space so that x is the normal 
vector of the plane P. 

4.4. Homogeneous Systems 
of Linear Equations 

We considered it appropriate to group the problems referring to homogeneous 
systems of linear equations in a separate section. In contrast to the nonhomo- 
geneous case, the question of consistency does not arise here; moreover, the 
algebraic structure of the solution set is also different, being a subspace for 
a homogeneous system and a plane for a nonhomogeneous system. 

Great attention has been paid to the two traditional tasks, viz. finding the 
complete solution and constructing the fundamental system of solutions. It 
was our intentions to emphasize the relationship of these two methods that 
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describe the solution subspace of a homogeneous system and Problem 4.4.13 
shows that the formulae for the complete solution coincide, in fact, with the 
description of this subspace in terms of a special fundamental system. 

At the end of the section we have indicated some of the applications of homo- 

f jneous systems of linear equations to the problems concerning linear spaces, 
e. finding the basis and dimension of a subspace, testing the equivalence of two 
vector sets, etc. 

4.4.1. Show that the solution set of an arbitrary homogeneous 
system of linear equations is a subspace, whereas the solutions may 
be considered as vectors of the corresponding arithmetic space. 

4.4.2. Two homogeneous systems of linear equations 

flu*! + . . . + amXn = 0, 


and 


0mi*i + . . . + a mn x„ = 0 
6n^i + . • . + 6,„x n = 0, 


bn x i + • • • + bt„x „ = 0 

are said to be equivalent if they have the same solution set. Prove 
that the indicated systems are equivalent if and only if the vector 
sets 

«1 = («!!. • • •. «ln). 


and 


Wm = (ami. • • •. «m n ) 
Vi = (&u. • • •. 6m). 


Vi = (6/i. • • •. 61„) 

are equivalent. 

4.4.3. A homogeneous system of m equations in n unknowns has 
a coefficient matrix with rank r. Prove that the dimension of the 
solution subspace of this system equals n — r. 

AAA. Indicate all the values of the parameter X for which the 
system of equations 

(8 — X) x 1 + 2x z + 3x s + Xx A = 0, 


x x + (9 — X) Xj + 4x s + Xx 4 = 0, 
Xj -f 2x, -f (10 — X) x s + Xx A = 0, 
x x + 2x s + 3x s + Xx 4 = 0 


is indeterminate. 
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Find the dimension of the solution subspaces of the following sys¬ 
tems in relation to the value of the parameter X: 

4.4.5. (1 - X) x 4 + Xx 2 + 2Xx a + 2Xx t = 0, 

(-1 + X) x 4 + (2 - 2X) x a - 2Xx a - 2Xx 4 = 0, 

(1 - X) x 4 + Xx 2 + (2 + X) x* + (1 + 2X) x 4 = 0, 

(—1 + X) x x — Xx 2 — 2Xx s + (2 — 3X) x 4 = 0. 

4.4.6. —4x 4 + (2 + 2X) x 4 + 2Xx a + 2Xx 4 = 0, 

+ (1 + X) x 2 + Ax 3 + Xii = 0, 

Xx 1 + (1 + X) x 4 — 2 x 3 + Xx 4 = 0, 

-Xxj — (1 + X) x 2 — Xx 3 — (2 + 2X) x 4 = 0. 

4.4.7. Let a homogeneous system of equations be of rank r. Prove 
that the minors of orders 1,2, . . ., r placed in the upper left-hand 
corner can be made different from zero by interchanging the equa¬ 
tions and renumbering the unknowns. 

In Problems 4.4.8-4.4.15 the following homogeneous system of 
equations is considered 

<*11*1 + <*12*8 + ■ ■ ■ + <*!„*,. = 0, 

<*21*1 + <*22*2 + • . . + <*2nX„ = 0, 

. (4.4.1) 

<*ml*l + <*m2*2 + • • • + <*mn*n = 0. 

The rank of this system is assumed to be equal to r, and the corner 
minors of orders 1,2, . . ., r of the matrix of the system are taken 
to be nonzero (which can be always achieved, according to Prob¬ 
lem 4.4.7, by changing the order of the equations and unknowns). 

4.4.8. Prove that, when applying the elimination method to sys¬ 
tem (4.4.1), a n , 022 . • • •» <*rr _,) can be chosen as the pivot at the 
separate stages while the resultant system of equations is of the form 

<*11*1 + <*12*2 + • • • + <*|r*r + <* 1 . r+l*r+l 4 ... +<*!„*„ =0, 

<*22*2+ • • • + <*2r’*r + <*2* V+1 *r+l + • • • +<*2n*n = 0, (4,4.2) 

<&" °*r + <*£-rV ,* r+ , + ...+a ( A-' ) X n = 0 

(those equations whose coefficients are all zero are omitted). 

4.4.9. Show that system (4.4.2) can be solved for x lt . . ., x r 
in terms of the free unknowns x r+1 , . . ., x„, in the following form: 

x, = c„x r+1 + c l2 x r+2 + ... + c,_ n _ r *„, 

*2 — C 21*r+1 + C 22*r+J+ • ■ - + c 2. n-r*n> (4.4.3) 

X r -= C r ,X r+l + C r2 X r+i — C r . „-r*n- 
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These formulae are termed the complete solution of system (4.4.1). 
This means that one possible solution of the first r components of 
system (4.4.1) may be found by giving arbitrary values to the free 
unknowns by formulae (4.4.3), and conversely, any solution of this 
system can be obtained in this way for the corresponding values of 
the free unknowns. 

4.4.10*. Prove that the solutions of system (4.4.1) 
y 1 = ( x ll> • • •> x lrt *1, r+l» • • •• ^ln)' 
y Z = (*2 . . x Z n X Z . . ..* 2n ). 


I/h = (*h„ .--.XHr, X fc>r+ „ ...,X ftn ) 

are linearly dependent if and only if the (n — r)-dimensional vectors 

2l = (*l.r+l.*m). 

H = ( X 2, r+ 1 > .... X 2n ), 


Zk = ( x h.r+ „ ....XfcJ 

are linearly dependent. 

4.4.11. Prove that a basis for the solution subspace of system 
(4.4.1) can be obtained as follows: fix some nonzero determinant of 
order n — r, and letting the values of the free unknowns x r+1 , . . . 
. . ., x„ fill the matrix rows in turn, find the corresponding values 
of the unknowns Xj, . . ., x r by formulae (4.4.3). The constructed 
n — r solutions form the basis. Any basis for the solution subspace 
of a homogeneous system of equations is called the fundamental so¬ 
lution set of this system of equations. 

4.4.12. Show that any fundamental solution set of system (4.4.1V 
can be constructed by the method indicated in Problem 4.4.11 by 
a correct choice of the determinant. 

4.4.13. Show that the vectors 

yt— ( c il> c 21» •••* c ri> f» 0, ...,0), 

y Z = ( c 12 ’ c 22 » • ••» c r Z i 0, 1* ... 1 0), 

'/ n -r = (Cl,n-r. C 2 . n-r. • ...C r . „_r. 0, 0, . . ., 1) 

form the fundamental solution set of system (4.4.1), where c, v are the 
coefficients of formulae (4.4.3). 

Adjoining the identities 

x r +i = x r+I , 


-r +2 — 


■r+ 2 > 
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to formulae (4.4.3), interpret the complete solution as the represen¬ 
tation of any solution of system (4.4.1) by a linear combination of 
the solutions y lt y 2 , .... y T whose coefficients are the values of the 
free unknowns. 

4.4.14*. Prove that the rank of the r X (n — r) matrix C, made 
up of the coefficients of formulae (4.4.3), is equal to the rank of the 
submatrix 

a 2. r +1 a 2. r+2 • i a 2n 


a m. r*i a m. r+2 ••• a mn 


of the coefficient matrix of system (4.4.1). 

4.4.15. Prove that all the coefficients of a free unknown x h (r < 
< k ^ n) in formulae (4.4.3) will equal zero if and only if all the 
coefficients of this unknown in the original system (4.4.1) equal zero. 

Find the general solution and the fundamental solution set of the 
following systems of equations: 




4.4.17. 9x 2 + 2lx 2 - 15x 3 + 5x 4 = 0, 

12xj + 28x 2 - 20x s + 7x 4 = 0. 

4.4.18. 14x t + 35xj - 7x s - 63x 4 = 0, 
—IOxj — 25x 2 + 5x 3 + 45x 4 = 0, 

26xj + 65 x 2 — 13x s — 117 x 4 = 0. 

4.4.19. 2xj — 5 x 2 -t 4x s -|-3x 4 = 0, 

3xj — 4 x 2 + 7x 3 -f 5 x 4 = 0, 

4xj — 9 x 2 + 8x 3 4- 5x 4 = 0, 

— 3x, -(- 2 x 2 — 5x 3 -I- 3x 4 = 0. 

4.4.20. 2xj+ x 2 4-4x 3 -!- x 4 = 0, 
3xj-|-2x 2 — x 3 — 6x 4 = 0, 

7xj + 4x 2 + 6x 3 — 5 x 4 = 0, 

Xi +8x 3 + 7x 4 = 0. 

4.4.21. XJ + 4X2 + 2X3 — 3x s = 0, 

2xj + 9 x 2 f 5x s — 2x t + x 5 — 0, 

Xj + 3 x 2 -|” x 3 — 2 x 4 — 9x s = 0. 
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4.4.22. 2x,— 2x 2 + 3 x 3 + 6x 4 + 5x 5 = 0, 

— 4x,+ 5x 2 — 7 x s — 3 x 4 + 8x s = 0, 
8x, — 9 x 2 4- 13x s + 15x t -f 2x s = 0, 

10x, — 12x 2 + 17x s 4- 12x 4 — 1 1x s = 0, 

— 6x, f 7x 2 —10x 3 — 9 x 4 + 3x s = 0, 

— 14x, + 17 x 2 — 24x 3 — 15x 4 + 19x 5 = 0. 

4.4.23. 2x,— x 2 — x 3 — x t — x 3 = 0, 

— x,-t-2x 2 — x 3 — x 4 — x 5 = 0, 

4xj -f — 5 x 3 — 5x 4 — 5x s = 0» 

x,+ x 2 + 2x 3 + x 4 + Xj = 0, 
x,+ x 2 + x 3 + 2x 4 + x 5 = 0. 

4.4.24. 3x,+ 6x 2 -f 10x 3 + 4x 4 —2x 5 = 0, 

6x, + 10x 2 + 17x 3 + 7x 4 — 3 x 5 = 0, 

9x, + 3x 3 -+• 2 x 4 + 3x 5 = 0, 

12x,— 2 x 2 + x 3 + 8x 4 + 5x s = 0. 

4.4.25. x t H-2x 2 + 3 xj+ 2x 4 — 6x s = 0, 

2x, + 3x 2 + 7x 3 + 6x 4 —18x s = 0, 

3x 1 + 5x 2 +11x 3 + 9x t — 27x 5 = 0, 

2x, — 7x 2 + 7x 3 + 16x 4 — 48x 5 = 0, 

x, -l- 4 x 2 + 5x 3 + 2x 4 — 6x 5 = 0. 

4.4.26. Verify that the system 


2xj -(- 4 x 2 -f - 6x 3 -J- 5x 4 -(- 3xj — 0, 

5x, -t- 6x 2 + 7x 3 + 9x 4 + 6 x 5 = 0, 

4xj -f- 6x 2 + 8x 3 + 7x t + 5x s = 0, 

5x, + 5x 2 + 5x 3 + 8x 4 + 6x 5 = 0, 

3x, + 4 x 2 -f 5 x 3 + 6x 4 + 4x s = 0. 

has infinitely many solutions, while in each of its solutions x 4 = 
= x 6 = 0. Explain these facts in terms of linear dependence or li¬ 
near independence of the columns of the matrix of the system. 
4.4.27. Indicate all the sets of unknowns that can be free un- 
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knowns of the system 

7x x — 4x 2 -f- 9x 3 -f 2x 4 4 2x 6 = 0, 

5®! + 8x 2 + 7x 8 — 4x 4 + 2x 6 = 0, 

3x x — 8 x 2 + 5x s + 4x 4 + 2 x 6 = 0, 

7x x — 2x 2 4- 2x 3 + 3:4 — 5x 5 = 0. 

4.4.28. In the space of polynomials of degree ^ n, determine the 
dimension of the subspace of polynomials / ( t) satisfying the condi¬ 
tions / (a x ) = / (ffl 2 ) = ... = / (a ft ) = 0 where a lf . . ., a h are 
different numbers. 

4.4.29. In the space of polynomials of degree ^ 5, find the basis 
for a linear subspace of polynomials / ( t) fulfilling the conditions 
/ (0) = / (1) = / (2) = / (3) = 0. 

4.4.30. Find a homogeneous system of linear equations consist¬ 
ing of (a) two equations; (b) three equations; (c) four equations, 
and for which the vector set 

Vi - (1. -2, 2, -1), 

y 2 = (3, 13, -1, 2, 1), 
y 9 = (2, 7, -8, 4, -5) 
is a fundamental solution set. 

4.4.31. Can a system of linear equations be found for which the 
vector sets 

Vi = (2, 3, 1, 2), 
y 2 = (l, 1, -2, -2), 
y 3 = (3, 4, 2, 1) 

and 

z x = (1, 0, 2, -5), 
z 2 = (0, 1, 8, 7), 
z 3 = (4, 5, -2, 0) 

are two fundamental solution sets? 

4.4.32*. The rank of a homogeneous system of linear equations 
consisting of n — 1 equations with n unknowns equals n — 1. Prove 
that a nonzero solution of this system can be constructed by the 
formulae 

x, = (—1)M ( , i = 1, . . ., n 

where A t is a minor derived from the coefficient matrix of the system 
by deleting the i-th column. In addition, show that any other solu¬ 
tion of the system and the indicated one are collinear. 
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4.4.33. With the aid of the result of Problem 4.4.32, find a vec¬ 
tor orthogonal to the set of vectors 

z x = (2, -1, 3, 1), 
z, = (1, 0, 2, -3), 
z 3 = (2, 3, 1, 4). 

4.4.34*. Prove the following theorem: For two linearly indepen¬ 
dent vector sets x x , . . ., i n _x and . . ., y„. x in an ra-dimensional 
linear space to be equivalent, it is necessary and sufficient that all 
n minors of order n — 1, made up of the coordinates of the vectors 
x v . . ., !„_! in any basis for this space, should be proportional to 
the corresponding minors made up of the coordinates of the vectors 

0i. • • •. Un -1* 

4.4.35. By means of the result of Problem 4.4.34, determine 
whether the vector sets of Problem 4.4.31 are equivalent. 


4.5. Nonhomogeneous Systems 
of Linear Equations 

The topics touched upon in this section are, for the most part, as follows: 

Criteria for the consistency of nonhomogeneous systems of equations and 
investigation into the consistency of individual systems. 

Finding the general solution of a system. In addition to purely computational 
problems, we also provide problems concerning the determination of the com¬ 
plete solution. As with the homogeneous case, we stress the fact that the for¬ 
mulae for complete solution yield, actually, the parametric equations for the 
solution plane of the given system of linear equations (see Problem 4.5.9). 
Note that the computational problems also point out certain techniques that 
are generally employed in practical computations, viz. a change of numeration 
and scaling of the equations and unknowns, use of individual features of a 
system, e.g. its property to decompose into several systems of the lesser order, 
or the triaiagonal form of the matrix of coefficients. 

In conclusion we list a number of problems referring to particular systems of 
linear equations. We indicate, inter alia, some applications of Cramer’s for¬ 
mulae. 


4.5.1. Prove that a nonhomogeneous system of m linear equations 
is consistent if the rank of the coefficient matrix of the unknowns 
is m. 

4.5.2. Prove that for the system 

<* 11*1 + < 112*2 + . . . + a ln x n = b lt 

a tl X l + a 22 X 2 + • • • + 0'2n x n = &2» 


a mi*i + a mJ x t + ... + a mn x n = b m 
to be consistent, it is necessary and sufficient that the vector 
b = (b lt 6„ . . ., b m ) 


(4.5.1). 
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should belong to the span of the vectors 
a, = (a,„ a tl . a ml ), 

fl 2 = ( a 12i a 22, • • a mi)t 


a n — ( a ln» °2n» • • •» a mn)- 

4.5.3. Prove the Fredholm theorem: for a homogeneous system 
(4.5.1) to be consistent, it is necessary and sufficient that the m-di- 
mensional vector b = ( b lt b 2 , . . ., b m ) should be orthogonal to 
all the solutions of the conjugate homogeneous system 

“llJ/l + ffl 21</2 + • • • + flmlJ/m = 0, 

ffl 12i/l + ffl 22l/2 + • • • + fl m2l/m = 0, 


flinJ/i + a in i /2 + . . . + a mn y m = 0. 

4.5.4. Given that a nonhomogeneous system of m equations in n 
unknowns is consistent and the rank of the coefficient matrix of the 
unknowns equals r, prove that the solution set for this system is a 
plane in an n-dimensional arithmetic space with dimension n — r, 
and whose directional subspace is the solution set of the corres¬ 
ponding homogeneous system with the same coefficient matrix of 
the unknowns. 

4.5.5. Two nonhomogeneous systems of linear equations 

aii*i + . . . + a ln x n = b lt 


and 


a m iXi + . . . + a mn x„ = b m 
Cn*! + • . • + c ln x n = dj, 


C,!*! + . . . + c ln x n = d t 

are called equivalent if either they are both inconsistent or both 
consistent, and have the same solution set. Prove that the indicated 
systems, if consistent, are equivalent if and only if the vector sets 
are equivalent 

= (an, • • •, Ain, &i), 


= (flmi, . . flmn, &m) 

and 

fli = (flu. <h). 


v i = ( c n, • • •• c i n, di )• 
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In the following verify whether the system is consistent and deter¬ 
mine the dimension of the solution plane in relation to the value 
of the parameter X. 

4.5.6. (5 — X) x 1 — 2x 2 — x 3 = 1, 

—2x 1 + (2 — X) x 2 — 2x 3 = 2, 

—Xi — 2x 2 + (5 — X) x 3 = 1. 


— X 1 + (1 + X) X. 

, + (2 - X) x, + Xx t = 3, 

Xx 2 - x 2 

+ (2 - X) x s + Xx t = 2, 

Xx 2 + Xx 2 

+ (2 - X) x 3 + Xxt = 2, 

Xxi + Xx 2 

+ (2-X)x 3 - x 4 = 2. 


Problems 4.5.8-4.5.11 concern consistent nonhomogeneous systems 
of equations of rank r, similar to (4.5.1). The equations are assumed 
to have a numeration that stipulates that the minors of orders 
1,2, . .. ., r, positioned in the upper left-hand corner, are nonzero. 

4.5.8. Applying the method of elimination of the unknowns, 
show that system (4.5.1) can be solved for x lt . . ., x T so that their 
expressions in terms of the free unknowns x r+1 , . . ., x„ may be of 
the following form: 

x, = c, 0 4 c u x r+i + c l2 x r+2 -\-... +c u n . T x n , 

x 2 ~ c 20 + c 2l x r+i + c 22 x r+2 + • • • + c 2. n-r x n » (4.5.2) 

X T = C T o + c M x r+ i + c r2 x r+2 + ... 4- c r , „_ r x„. 

These formulae are known as the complete solution of system (4.5.1). 
Formulae (4.4.3) are a particular case of formulae (4.5.2). 

4.5.9. Show that the vector 

*o = foo. c 20 , . • c r0 , 0, 0, . . ., 0) 
is a solution of system (4.5.1) and the vectors 

l/i = (ch. c 21 , .... c M , 1, 0.0), 

y 2 = ( c i 2 c 22 , .... c r2 , 0, 1.....0), 

Pn-r = (C,, n-r. c 2. n-r* C r , „-r> 0. 0, . . ., 1) 

form a fundamental solution set of the corresponding homogeneous 
system. 

By adding the identities 

x r+i = x r+l* 
x r+2 — x r+2’ 


X n = 
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to formulae (4.5.2), interpret the obtained relations as parametric 
equations of the solution plane of system (4.5.1). 

4.5.10. Prove that the rank of the matrix, 

c 20 C 21 c 22 • ■ • c 2. n-r 
II c ro c ri c r2 • • • c r. n-r II 

made up of the coefficients of formulae (4.5.2), equals the rank of 
the submatrix 



of the augmented matrix of system (4.5.1). 

4.5.11. Prove that the vector 

2| = (Cii, c u , . . ., c r< ), i = 1, . . ., n-r 
is a solution of the system of equations 

<*11*1 + . . • + ai,Xr = —flu. 


a n x i + • • • + a rr x r = — a ri , 

and the vector z 0 = (c 10 , c 20 , . . ., c r0 ) is a solution of the sys¬ 
tem of equations 

flu*! + . . . + Air*r = b lt 


a n x i + . . . + a r r*r = b r . 

Investigate the consistency and find the general solution of the 
following systems of equations 

4.5.12. 38x,— 74 x 2 + 46x 3 + 84x 4 = 90, 

-95x 1 + 185x 2 -115x 3 -210x 4 = -225, 

57XJ-111X2+ 69x 3 + 126x 4 = 135. 

4.5.13. 105x, — 175 x 2 — 315x 3 + 245x t = 84, 

90x,— 150x 2 -270x 3 + 210x 4 = 72, 

75x, - 125 x 2 — 225x 3 + 175x t = 59. 

7x, — 5x 2 — 2x 3 — 4x 4 = 8, 

— 3x, + 2 x 2 + x 3 -J-2x 4 =—3, 

2x|— x 2 — x 3 —2 x 4 = 1, 

— x, + x 3 + 2x 4 = 1, 

— x 2 + x 3 -j-2x 4 = 3. 


4.5.14. 
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4.5.15. x,+ 2x 2 + 3 x 3 4- 4x t = 0, 

7xj + 14 x 2 4 20x 3 4- 27x t = 0. 

5x, -f- 10x 2 -|- 16x s -f- 19x t = — 2, 
3x,+ 5 x 2 + 6x s + 13x 4 = 5, 

4.5.16. x, + x 2 =1, 

x, + x 2 4-x 3 = 4, 

X 2 4" x 3 + x i — —3, 

X 3 x t + x 5 = 2, 

x 4 4- x 5 = — 1. 


4.5.17. 12x, — 18 x 2 -f 102x s — 174x 4 — 216x s — 132, 

14x, — 21 x 2 + 119x 3 — 203x t — 252x 5 =- 154, 

*s+ 2 x 4 + 3x 5 =—1, 

4x s + 5 x 4 -\- 6x 5 = — 2, 

7x s + 8x t + 9x 5 = —3. 

4.5.18. 24*,+ 9x 2 + 33x s -15x 4 =21, 

8x,+ 3x 2 + llx 3 — 5x 4 = 7, 

40x, -J- 15 x 2 + 55x 3 — 25x 4 + 213x 3 — 35, 

56x, + 21x 2 + 77x s - 35 x 4 + 197x 5 = 49. 

4.5.19*. 2000x, + 0.003x 2 -0.3x 3 + 40x 4 = 5, 

3000x, + 0.005x 2 — 0.4 x 3 + 90x t = 8, 

500x,+ 0.0007x 2 —0.08x s + 8x 4 = l.o, 

60000x, + 0.09 x 2 - 9x 3 + 1300x 4 = 190. 

4.5.20. x, + 2 x 2 — 5x 3 + 4x 4 + x 5 = 4, 

3x, + 7 x 2 — x 3 — 3x 4 + 2x s = 10, 

— x 2 — 13 x 3 — 2x 4 + x 5 =—14, 
x 3 — 16 x 4 + 2x 5 = —11, 

2x 4 + 5x 5 = 12. 

4.5.21. 8x, + 12x 2 = 20, 4.5.22. x,-5x 3 +2xe= 6, 

14x 1 + 21x 2 = 35, 2x 2 + x 4 + 3x } = 6, 

9x 3 + llx 4 = 0, 2xj — 7x 3 + 3x a = 4, 

16x 3 + 20x t = 0, 3 x 2 + 2x 4 + 4xj= 7, 

10x 5 +12x e =22, 2xj— x 3 + x e = —12, 

15x 3 + 18x e = 33, 4 x 2 + 3x 4 + 5x s = 9. 
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Investigate the following systems and find their general solutions 
in relation to the value of the parameter A,: 

4.5.23. 3*! + 2x 2 + x 3 = -1, 

7x 3 + 6x 2 + 5x a = X, 

5x, + 4x 2 + 3x a = 2. 

4.5.24. Xx,+ x 2 + x a = 0, 

5x, + x 2 —2x 3 = 2, 

— 2x t — 2x 2 + x a = -3. 

4.5.25. 24a:,- 38x 2 + 46x a = 26, 

60x,+ Xx 2 + 115x 3 = 65, 

84x, — 133x 2 + 161x a = 91. 

4.5.26. x,J- x 2 + A.x 3 = l, 
x, + Xx 2 + x 3 = l, 

kx t + x 2 + x 8 =l. 

4.5.27. ®,-|- x 2 -j- Xx 3 — 2, 

Zt + Xx 2 + x 3 =— 1, 

Xx, + x 2 + x 3 — —1. 

4.5.28. x, -f- x 2 -f- Xx 3 — 3. 
x i-\-Xx 2 -\- x a -0, 

A,x,+ x 2 + x 3 = 0. 

4.5.29. (3 — 2X) x, -j- (2 — X) x 2 + x 9 = X, 

(2 — X) x, + (2 — X) x 2 = 1 < 

* 1 + x 2 + (2 — X) x 3 = l.| 

4.5.30. (3 + 2\)x, + (l -t-3X)x 2 + Xx 3 + (>.-l)x t =3, 

3Xx, + (3 + 2X)x 2 + Xx 3 + (X — 1) x 4 = 1, 

3A,x,4- 3A,x 2 + 3x a + (X — 1) x 4 = 1, 

3A.x,+ 3Xx 2 + A,x 3 + (X, — 1) x 4 = 1. 

4.5.31. Verify that in all solutions of the system of equations 

2x,+ 3 x 2 + x 3 +x s = 6, 

x, + 2x a + x $ x k — 5, 

— x, + x 2 -f-3x a -|-5x 4 -|- Xj = 8, 

2x, — x 2 -I - x 3 — 8x 4 4" 2x 5 — 1 — 6, 
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the values of the unknowns x s and x 6 are constant and equal to 1 
and 0, respectively. Account for this fact in terms of the linear de¬ 
pendence and linear independence of the columns in the augmented 
matrix of the system. 

4.5.32. Can the general solution of the same system of linear 
equations in 8 unknowns be described by the formulae 
X| = x s + 2x 0 4- 3x 7 4- 4x 8 , 
x 2 = 2x s + 3x # + x 7 + 2x B , 


and 


x 3 = x s t x e + x 7 x 9 , 
x t = x, — 2 x 7 — 6x g 

x 5 = 21x, — 6x 2 — 26 x 3 + 17x 4 , 
x a = — 1 7x, -f 5x 2 + 20x s — 13x t , 
x 7 = — X, + 2x s — x 4 , 
Xg = 4x,— x 2 — 5x s + 3 x 4 ? 


(4.5.3) 


4.5.33. Replace the first relation in formulae (4.5.3) of Problem 
4.5.32 by 

x 5 = 22x 7 — 6x 2 — 26x, + 17x 4 


and answer the problem question again. 

4.5.34. Prove that the set of polynomials / (t) of degree satis¬ 
fying the conditions / (aj) = b Jt f (a 2 ) = b 2 , . . ., / ( a h ) = b h (where 
fc ^ n + 1 and a 7 , . . ., a h , b lt .... b h are arbitrary numbers, 
whereas all a lt 1 ^ i ^ fc, are diHerent) is nonempty and produces a 
plane. Find the dimension of this plane. 

4.5.35. Find three linear independent polynomials / ( t) of degree 
^ 5 fulfilling the conditions / (0) = 1, / (1) = 0, / (2) = —5, 
/ (3) = -20. 

4.5.36*. Verify that the system of equations 


Xj — x 2 -f- Xg — 2 x 4 — —2 , 

8x, 4 - 7x 2 -f / x 3 — 9x 4 = 3, 

6 x t 4 -5x 2 4 -5x s — 5 x 4 = 7 

is consistent and find a normal solution to this system. 

4.5.37. Prove that for a nonhomogeneous system of linear equa¬ 
tions, with the number of the equations equal to the number of the 
unknowns, to be consistent it is necessary and sufficient that the 
reduced homogeneous system should have a unique solution. 

4.5.38. The columns q lt q 2 , . . ., q n of the coefficient matrix of a 
system of n linear equations in n unknowns form an orthonormal 
set. Prove that this system is fully defined, and that its solution can 
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be evaluated by the formulao x t = (6, q t ), i = 1, . . n. 
Here b is an w-dimcnsional vector made up of the right-hand sides 
of the system, and the scalar product is defined by the usual rule 
for an arithmetic space. 

4.5.39. Prove that the statement of Problem 4.5.38 also holds 
for a consistent system in which the number of equations does not 
•equal the number of the unknowns (the same condition of the ortho- 
normality of the columns, however, being maintained). 

4.5.40. Using the result of Problem 4.5.38, solve the following 
system of equations: 

ax i + bx 2 + cx j + dx 4 = p , 

— bx l -f- ax 2 + dx 3 — cx 4 = q, 

—cx 1 — dx 2 + ax 3 + bx 4 = r, 

—dx t + cx 2 — bx 3 + ax 4 = s 

assuming that A = a 8 + b 2 + c* + <P =£ 0. 

4.5.41. Deduce from the result of Problem 4.5.34 that if the 
values of two polynomials / (t) and g(t) of degree coincide for 
more than n different values of the argument, then these polyno¬ 
mials are equal (i.e. the corresponding coefficients of the polyno¬ 
mials coincide). Hence deduce that the given definition of equality 
for two polynomials is equivalent to their equality as functions 
(i.e. to coincidence of their values for all values of the unknown). 

4.5.42. Find a polynomial / (t) of the third degree for which 
J (1) = -2, / (2) = -4, / (3) = -2, / (4) = 10. 

4.5.43. Find a polynomial f(t) of degree ^4 for which /(—2) = 
= 10, / (1) = 4, / (-3) = 60, / (2) = -10, / (-1) = -4. 

4.5.44*. Prove that a polynomial f(t) of degree ^2 k, satisfying 
the conditions /(a,) = /(— a t ), i = 1, . . ., k, where a?, . . ., a| 
are different nonzero numbers, is necessarily even, i.e. the equality 
/ (—t) = / ( t ) holds true. 

4.5.45. Prove that a polynomial / (t) of degree ^2 k — 1 fulfilling 
the conditions / (a,) = — f (—ad, i = 1 , . . ., k, where a?, . . ., a* 
are different nonzero numbers, is necessarily odd, i.e. the equality 
i (—t) = —/ ( t ) is valid. 

4.5.46. Prove that whatever the numbers a, b„, b t , . . ., b n are, 

there exists, and is unique, a polynomial / (t) of degree such 
that / (a) = b 0 , /' (a) = 6,./<") (a) = b n . 

k.bAl. Find a polynomial f(t) of degree <4 such that /(2) = 5, 
f (2) = 19, /<*> (2) = 40, /<»> (2) = 48, /< 4 > (2) = 24. 

4.5.48*. Prove that whatever the numbers a lt a 2 , b 0 , b lt . . . 
. . ., £>„_!, c 0 (a x a 2 ) are, there exists, and is unique, a polynomial 
f ( t) of degree such that / (aj) = b 0 , /'(a t ) = . . ., /< n_1 > (a x ) = 

= K -i, / (a 2 ) = c 0 . 
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4.5.49. Find a polynomial / (t) of degree ^4 such that /(1) = 
= -3, f (1) = -3, /‘ 2 > (1) = 12, /<’> (1) = 42, / (-1) = 3. 

4.5.50*. Prove that whatever the numbers a lt a 2 , b 0 , b lt ... 
. . ., b k , c 0 , Cj, . . ., c, (flj a 2 , k + l = n — 1) are, there exists, 

and is unique, a polynomial of degree such that the conditions 

/ (a,) = b 0 , /; (a,) = b lt . . ., /«*) (a,) = / (fl 2 ) = c 0 , /' (a 2 ) = 

= Cj, . . ., /<*) (a 2 ) = cj are met. 

4.5.51. Find a polynomial / (£) of degree ^5 such that / (1) = 
= -2, /' (1) = -7, /< 2 > (1) - -14, /<*> (1) = 24, / (2) = -4, 
/' (2) = 25. 

4.5.52. The right-hand sides b { of a certain system of n linear 
equations in n unknowns are differentiable functions of a variable t ; 
the coefficients a t j of the unknowns are constant numbers. Prove that 
the components x v . . ., x n are also differentiable functions of t, 
and 



4.5.55. Prove that the solutions x lt . . ., x h of certain systems 
of linear equations with the same coefficient matrix (and with right- 
hand sides bj, . . ., b h ) are linearly dependent if and only if the 
righl-lnnd sides are linearly dependent. 








CHAPTER 5 


Linear Operators 
and Matrices 


5.0. Terminology and General Notes 

Given two linear spaces X and Y both real or both complex. A re¬ 
lation between the elements of these spaces that matches each vector 
x £ X with one particular vector y £ Y is called a linear operator A 
from X to Y. The vector y is called the image of the vector x and is 
denoted by Ax, moreover 

A {ax x -f Pz 2 ) = aAx x + flAx t 

for any vectors x x and x t and any numbers a and p. Since we will 
only be considering linear operators from now on, the word “linear" 
is sometimes omitted. 

The set of all vectors Ax, x {X, is called the range or image of the 
operator A and is designated by T A . The set of all vectors x, for 
which Ax = 0, is called the kernel of the operator A and designated 
by N A . The image and kernel of a linear operator are linear spaces 
(see Sec. 5.1). The dimension of the subspace T A is denoted by r A and 
is called the rank of the operator A and the dimension of the subspace 
N a is denoted by n A and is called the defect of the operator A. 

Let the set of all linear operators from X to Y be co xy . The struc¬ 
ture of a linear space can be defined for the set to^y, that is we can 
put 

(i) (A + B) x = Ax + Bx\ 

(ii) {XA)x = k {Ax), 

where x is an arbitrary vector from X. The operators defined by these 
relations, i.e. A + B and \A, are called the sum of the operators A 
and B, and the product of the operator A by a number k, respectively. 
The zero element of the linear space (o XT is the zero operator from X 
to Y, i.e. the operator matching each vector from X with the zero 
element of the space Y. 

Now, let A 6 %r. B £ a> rz . An operator C = BA from X to Z 
and defined by the relation 

Cx = B {Ax), 

is called the product of the operator B by the operator A . For the prod¬ 
uct BA to have any sense it is a necessary and sufficient condition 
that the image of the operator A should be contained in the domain 
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of the operator B. This condition is inevitably fulfilled in the case 
of operators from <o xx . We will say about each of such operators 
that it is on the space X. 

For an operator A from (o xx , a natural power A h may be defined 
as the product of k operators equal to A. By definition, for any op¬ 
erator A we put 

A° = E, 

where E is the identity or unit operator (i.e. the operator matching 
each x £ X with the same vector x). If 

/ ( t) = a 0 + a y t + a 2 P + . . . + a h t h 
is an arbitrary polynomial, then the operator 

/ {A) = a 0 E + a r A + a 2 A 2 + .. . + a h A h 

is called a polynomial / (i4) in the operator A. 

The operator A on an n-dimensional space X is called nondegene¬ 
rate if the defect of this operator equals zero, or in other words, if 
the rank equals n. For a nonhomogeneous operator A there exists, 
and is unique, a linear operator B such that] 

AB = BA - E. 

The operator B is called the inverse of the operator A and is denoted 
by A~ l . 

With the aid of the inverse operator, the whole negative powers of 
a nondegenerate operator A can be defined. Namely, if k is a natural 
number, we put 

A~ h = (A~')» 

or, equivalently 

A~ h = (A h )~K 

A matrix C = A + B of order m X n is called the sum of the 
matrices A and B of order m X re if 

c tj = a u + • • m m, f = 1, . . ., re. 

An m X re matrix D = XA such that 

d ti = Xa lf , i = 1, . . ., ire, f — 1, . . ., re 

is called the product of the matrix A by the number X. 

The unit matrix (cf. Sec. 3.0), just like the identity operator, is 
denoted by E. If the order re of a unit matrix should be explicit, the 
notation E n is employed. Matrices of the form XE are said to be 
scalar. 

A matrix C of order p X re such that 

C H= 2 b lk a h) , i = l, .... p, ; = 1, ..., re 
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is called the product BA of a p X m matrix B and an m X n matrix 
A. For the product BA to have sense it is a necessary and sufficient 
condition that the number of columns of the matrix B should equal 
the number of rows of the matrix A . This condition is necessarily ful¬ 
filled if both matrices are square matrices of the same order. 

For a nondegenerate matrix A (i.e. a square matrix with a nonzero 
determinant, cf. Sec. 3.0) there exists an inverse matrix A _1 satis¬ 
fying the equalities 

AA- 1 = A- 1 A = E. 

If we put B = A _1 then the elements b tJ of the matrix B can be 
computed by the formulae 

( 501 > 

A Jt being the cofactor of the element a }l . 

If a square n X n matrix C is the product AB of two rectangular 
matrices A and B of dimensions n X m and m X n, respectively, m 
being ^n, then for the determinant of the matrix C the Binet-Cauchy 
formula is valid: 

2 -< *,::: LX* ::: !!")• < 5o - 2 > 

In particular, if A and B are also square matrices then 

det AB = det .4 -det B. (5.0.3) 

Let A be an operator from d) xr and let e x , . . ., e„ and q x , ... 

. . ., q m be fixed bases of the spaces X and Y, respectively. Resolve 
the vectors Ae u . . Ae n in terms of the basis vectors q x , . . ., q m : 
Ae x = a u q! + a n q 2 + . . . + a ml q m , 

Ae 2 = a 12 q x + a 22 q 2 + . . . + a m2 q m , 


Ae n = a ln q x + a 2n q 2 + . . . + a mn q m . 


Construct an m X n matrix of the coefficients in these decompositions 


Aq e — 


«21 “21 • • • °2n 

°mi a m 2 • ■ • a mn 


(5.0.4) 


A qe is said to be the matrix of the operator A in the pair of bases e x , ... 
. . ., e„ and q x , . . ., q m , or to define the operator A in this pair of 
bases. 

An m X 1 matrix is called an m-dimensional column vector, an 
1 X n matrix is called an ra-dimensinnal row vector. Let each vector 
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x 6 X correspond to an n-dimensional column vector x e made up- 
of the coordinates of this vector in a basis e lt . . ., e„. Similarly, 
each vector y £Y can be matched with an m-dimensional column 
vector y q of the coordinates of this vector in a basis q lt . . ., q m . 
Then the relation between the coordinates of the vector x and vector 
y = Ax can be determined by a matrix equality 

y q = A qe x e . (5.0.5) 

To describe an operator A from (o_ y .y it suffices to fix one baste 
e v . . e„, with the vectors Ae lt . . ., Ae„ being decomposed in 

terms of this basis. The matrix made up of the coefficients in the 
decompositions is denoted by A e and is called the matrix of the 

operator A in the basis e lt . . ., e„. A e is also said to define the opera¬ 

tor A in this basis. Formula (5.0.5) is converted into 

y e = AgX e . (5.0.6) 

Let in a space X two bases be fixed: e v . . ., e„'and / lt . . ., /„. 
Decompose the vectors f lt ...,/„ in terms of the basis e v . . ., e n 

h = Pll^l + Pm** + • • • + Pnl^nt 
ft = Pi& + p tt e 2 + • . . + p nt e„. 


in = Pin^i + Pinet + . . . + P„„e n . 

A matrix can be constructed from the coefficients in these decom¬ 
positions 

IIPll Pu ••• Pm II 

i>= ••• p * n II . (5.0.7) 

llpni Pm ••• Pnn II 

This matrix P is called the matrix of the transfer from the basis c lt ... 

. . ., e„ to the basis f x , If x e and x f are columns of the coor¬ 

dinates of a vector x in these two bases, then the relation between 
them is given by the equality 

x 8 = Px f . (5.0.8) 

It is now possible also using the transfer matrix to write down the 
relation between the two matrices A e and A f , that determine the 
operator A on the space X; thus: 

A f = P-'AgP. (5.0.9) 

If A 6 w.vy and if in each of the spaces X and Y two bases are 
fixed, i.e. e t , . . ., e n \ f t , ...,/„ and g x , . . ., q m \ f x , . . ., i m , 
respectively, then the matrices A qe and A,, are connected by a re- 
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lation 

A if = (5.0.10) 

where P is the matrix of the transfer from e lt . . ., e n to /,, 

and Q is the matrix of the transfer from q lt . . ., q m to t l% . . ., t m . 

If the elements of an arithmetic space are written in the vector- 
column form, then formula (5.0.5) makes it possible to identify op¬ 
erators in R n with those in R m , or operators in C n with those in C m , 
using m X n matrices which are real or complex, respectively (for 
further details see Problem 5.6.7). With this remark in mind, we 
will speak, hereafter, of the image of a matrix, its kernel, etc. 


5.1. The Definition of 
a Linear Operator, the Image 
and Kernel of an Operator 

In addition to examples of operators in concrete linear spaces, we provide 
a number of problems related to the definition of a linear operator. Further, the 
effect produced by a linear operator on the principal relations of a linear space 
(such as linear dependence, equivalence of vector sets, the sum of subspaces, 
etc.) is given prominence. 

At the end of the section the important concepts of a kernel and image are 
discussed. 

Determine, for each of the following operators on the three-di¬ 
mensional Euclidean space of geometric vectors, whether the opera¬ 
tor is linear. All the operators are described by their effect on an 
arbitrary vector x. Further, a and 6 signify fixed vectors of the space, 
and a is a fixed number. 

5.1.1. Ax = a. 5.1.2. Ax = x + a. 5.1.3. Ax = ax. 5.1.4. Ax = 
= (x, a) a. 5.1.5. Ax = (a, x) b. 5.1.6. Ax = (a, x) x. 5.1.7. Ax = 
= lx, a}. 5.1.8. Ax = [a, [x, 611. 

Verify which of the following mappings of the three-dimensional 
Euclidean space of geometric vectors into the set of real numbers 
are linear operators. All the mappings are described by their effect 
on an arbitrary vector x, a and 6 being fixed vectors of the space 
and a a fixed number. 

5.1.9. /(x) = a. 5.1.10. /(x) = (x, a). 

5.1.11. / (x) = cos (x, a). 5.1.12. / (x) = (x, x). 

5.1.13. /(x) = ([a, xl, 6). 5.1.14. / (x) = (x, [a, xl). 

Determine which of the following transformations of the three- 
dimensional arithmetic space are linear. Each transformation is 
described by its effect on an arbitrary vector x, while the components 
of the image vector are given by functions of the components of the 
vector x. 

5.1.15. Ax = (x lt x 2 , x*). 5.1.16. ^4x = (x 3 , x x , x 2 ). 

5.1.17. Ax = (x 3 , Xj, x 2 — 1). 

5.1.18. Ax = (x x + 2x 2 — 3x s , 3x x — x 2 + 3x 3 , 2x x + 3x a + 2x 3 ). 
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Find the linear operators on the space M n of polynomials of 
degree ^ n in the real variable t among the transformations given 
below. Each transformation is described by its effect on an arbitrary 
polynomial / (1). 

5.1.19. Af (t) = f (-t). 5.1.20. Af (t) = f(t + 1). 

5.1.21. Af (t) = f (at + b), where a and b are fixed numbers, 
while a =£ 0. 

5.1.22. Af (t) = f (t). This operator is called the differential 
operator. 

5.1.23. Af (t) = f (h) (t). This operator is called the differential 
operator of multiplicity k. 

5.1.24. Af (t)=f(t + 1) -/(*)• 

5.1.25. Af (t) = f (t + i) — g (t ), where g (t ) is a fixed nonzero 
polynomial. 

5.1.26. Af (t) = tf (t ). 5.1.27. Af (t) - / («*). 

5.1.28. Show that (a) the transformation indicated in Prob¬ 
lem 5.1.22 can be treated as a linear operator from M n into M n .y, 
(b) the transformation indicated in Problem 5.1.26 is a linear operator 
from M n intoAf n+1 ; (c)the transformation indicated in Problem 5.1.27 
is a linear operator from M„ into Af s „. 

5.1.29. Given that a linear space X is the direct sum of subspaces 
L x and L 2 , show that the operator P that assigns to each vector x 
from the space X with the decomposition 

x = x x + x f 

where x x 6 L u x 2 6 the vector x x of this decomposition, is linear. 
The operator P is known as a projection operator of the space X on 
L 2 parallel to L 2 . 

5.1.30. A linear space X is the direct sum of subspaces L x and L 2 . 
Prove that the operator R matching each vector x from the space X 
with the decomposition 

x = x x + x 2 , 

where x x £ L x and x 2 6 ^ 2 . with the vector y = x x — x 2 , is linear. 
The operator R is called the reflection of the space X in L x parallel 
to L 2 . 

5.1.31. State the geometric sense of the orthogonal reflection of 
a three-dimensional Euclidean space in a two-dimensional sub¬ 
space L. 

5.1.32. Given that in a linear space X a basis e lt . . ., e„ is 
fixed, prove that the mapping that matches each vector x of the 
space with its i-th coordinate in this basis, is a linear operator 
from X into the space of real or complex numbers. The linear opera¬ 
tor mapping the space X into the corresponding number field is 
called a linear functional on X. 


8—0619 
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5.1.33. Prove that each linear operator on a one-dimensional 
space can be reduced to a multiplication of all the vectors of the 
space by a number fixed for the given operator. 

5.1.34. Describe all linear operators of the space R + (see Prob¬ 
lem 1.1.6). 

5.1.35. Prove that any linear operator transforms a linearly 
dependent set of vectors into a linearly dependent vector set. 

5.1.36. Is the following statement valid: a linearly independent 
vector set is transformed by any linear operator into a linearly 
independent set? 

5.1.37. Is the statement true: if vector sets x x , . . ., x k and 
tfi, . . y t are equivalent, then for any linear operator A the 
vector sets Ax x , . . Ax h and Ay v . . Ay t are also equivalent? 

5.1.38. Let A £ ®xy and L be an arbitrary subspace of a space X. 
The set of vectors Ax, where x £ L, is called the image of the 
subspace L and denoted by AL. Prove that AL is a subspace of 
the space Y. 

5.1.39. Prove that the dimension of a subspace AL does not 
exceed the dimension of the subspace L. 

5.1.40. Let L be the sum of subspaces L x and L 2 , and L 0 their 
intersection. Is it true that for any linear operator A (a) AL = AL l + 
+ AL 2 , (b) AL 0 = AL t (1 ALJ 

5.1.41. Give an example of a linear operator for which the formu¬ 
la (b) of Problem 5.1.40 does not hold. 

5.1.42. Show that a linear operator A has a unique effect on any 
vector from a space X given that the images Ae x , . . ., Ae„ of the 
vectors e j, . . ., e n , which form a basis for the space X, are known. 

5.1.43. Let e lt . . ., e n be a basis for a space X, y x , . . ., y n 
an arbitrary vector set of a space Y. Prove that there exists, and is 
unique, an operator A from “iy such that Ae t = y lt i = 1, . . ., n. 

5.1.44. Let x,, . . ., x h be an arbitrary vector set of a space X, 
y x , . . ., y k an arbitrary vector set of a space Y. Is the following 
statement true: there exists a linear operator A from that 
transforms the vectors x t into the vectors y t , i = 1, .... k? 

5.1.45. In addition to the data of Problem 5.1.44, assume that 
the vector set x v . . ., x h is linearly independent. Will the state¬ 
ment of the problem still remain valid? 

5.1.46. Given that a basis e„ . . ., e„ for a space X is fixed, 
show that the operation of a linear functional / on an arbitrary 
vector x can be determined by the formula 

/ (x) = + . . . + c n a„, (5.1.1) 

where cc lt are the coordinates of the vector x, and c t , . . . 

. . ., c„ are the images of the basis vectors. Conversely, formu¬ 
la (5.1.1) determines a linear functional on X for any numbers 
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5.1.47. Show that the formula 

<p/ ( t) = f (a 0 ) 

defines a linear functional <p on the space M n of polynomials of 
degree ^n. Here / is an arbitrary polynomial from Af„ and a 0 
is a fixed number. Is the converse statement valid: any linear function¬ 
al <p on Af„ can be defined thus, given a convenient choice of the 
number a 0 ? 

5.1.48. Let L be a subspace of a space X and A an arbitrary opera¬ 
tor from (i) ir . Show that the effect produced by the operator A on 
the subspace L can be considered as (a) the operation of a lin¬ 
ear operator from L into Y; (b) that of a linear operator from L 
into AL. 

5.1.49. Let L be a subspace of a space X and A a linear operator 
from L into a certain space Y. Show that there is a linear operator 
from X into Y whose effect on the subspace L coincides with that 
of the operator A. 

5.1.50. Construct two diSerent linear operators on the space M n 
of polynomials of degree that coincide with the differential 
operator on the subspace M n . y . 

5.1.51. Let a space X be the direct sum of subspaces L„ . . ., L h . 
Show that the effect of a linear operator A on any vector of the space 
is uniquely determined, if the effect of this operator on each of the 
subspaces L lt . . ., L h is known. 

5.1.52. Let A be a linear operator on a real linear space R, and C 
be a complex space obtained from R by complexification (see Prob¬ 
lem 2.5.13). Define an operator A on C as follows: for any vector 
z = x + iy from C where x, y 6 R, we put 

Az = Ax + iAy. 

Show that the operator A is linear. 

Can any linear operator of the space C be obtained in this 
way? 

5.1.53. Can a linear functional on a complex linear space assume 
only real values? 

5.1.54. Show that the kernel N A of an arbitrary linear operator A 
from (o X y is a linear subspace of the space X. 

5.1.55. Is it true that any subspace of a space X is the kernel of 
a certain linear operator from X to y? 

5.1.56. According to Problem 5.1.38, the image T A of an arbitrary 
linear operator A from <o jr is a subspace of the space Y. Is it true 
that any subspace of a space Y is the image of a certain linear opera¬ 
tor from X to y? 

5.1.57. Prove that the set of all preimages of a vector y from T A 
is a plane from the space X with the directional subspace N A . 

5.1.58*. Construct, for an operator A from to X r, a one-to-one 
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correspondence between T A and the planes of the space X of the 
form P = x 0 + N A . 

5.1.59. The set M of all planes of the space X of the form P = 
= x 0 + N A is, according to Problem 4.2.18, a linear space. 

Prove that the correspondence between planes from M and vectors 
from T A constructed in Problem 5.1.58 is a linear operator (from M 
to T A ). Find the kernel and defect of this operator. 

5.1.60*. Prove that for any operator A from co xr the sum of the 
rank and defect equals the dimension of the space X. 

5.1.61. Give an example of a linear operator from G) XJC such that 
the space X is not the direct sum of the image and kernel of this 
operator. 

5.1.62. Let M be any subspace complementary to the kernel N A 
of an operator A. Prove that (a) any linearly independent vector 
set from M is transformed by the operator A into a linearly inde¬ 
pendent set (cf. Problem 5.1.36); (b) the subspace M is mapped by 
the operator A onto its image T A by a one-to-one mapping. 

5.1.63. Prove that for any two subspaces, e.g. N of an n-dimension- 
al space X, and T of a space Y, such that dim N + dim T = n, 
there is a linear operator A from o) xy whose kernel coincides with N 
and whose image coincides with T. 

5.1.64. Construct two different linear operators on M n having 
the same image and kernel. 

5.1.65. Let A be an operator from X to Y, and L be a subspace 
satisfying the inclusion L cz T A . Prove that the set of vectors x 
of the space X whose images belong to L (called the complete preimage 
of the subspace L) is also a subspace, and its dimension equals 
dim L + n A . 

5.1.66. Find the defect of a linear functional f on an n-dimensional 
Space X. 

5.1.67. Find the kernel of each of the linear functionals on a three- 
dimensional Euclidean space / x (x) = (x, a) and / 2 (x) = ([a, x], b). 

5.1.68. Find the image and kernel of the linear operator on a three- 
dimensional Euclidean space defined by the formula Ax = [x, a], 

5.1.69*. Do the above for the operator Ax = [a, [x, 5]]. 

Determine the defect and rank of the following transformations 
of a three-dimensional arithmetic space and construct the bases for 
their kernels and images. Each transformation is described by its 
effect on an arbitrary vector x, while the components of the vector Ax 
are given as functions of components of the vector x. 

5.1.70. Ax = (x x + x 2 + x 3 , x 1 + x 2 + x 3 , x x + x 2 + x 3 ). 

5.1.71. Ax = (2x 1 — x 2 — x 3 , x x — 2x 2 + x 3 , Xj + x 2 — 2x 3 ). 

5.1.72. Ax = (—X! + x 2 + x 3 , x x — x 2 + x 3 , x r + x 2 — x 3 ). 

5.1.73. Describe the image and kernel of the differential operator 
on the space M n . 
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5.1.74. Consider the difference operator A h on the same space M n 

Jum= , " + T m , 

where h is a fixed nonzero number. Find its image and kernel. 

5.1.75. Consider the following mapping of the space M n into an 
arithmetic space: 

/(<) -(/(«!), • ■ / ( a h)), 

where a lt . . ., a h are different numbers. Find the defect of this 
operator. 

5.1.76. Find the image and kernel of the projection operator 
(see Problem 5.1.29). 

5.1.77. Prove that in complexifying a real space R, the rank and 
defect of an operator A from w x y are preserved during the transfer 
to the operator A (see Problem 5.1.52). 

5.2. Linear Operations over Operators 

The set ury of all linear operators from X to Y is considered, in the present 
section, as a linear space. Particular attention is drawn to the following topics: 

(i) The dimension of the space a>jjy. 

(ii) Some of the classes of subspaces of co^y. Here we examine the details 
of the relation between the properties of linear dependence of operators from 
Wjy and the mutual disposition of the images of these operators. 

(iii) The rank of the sum of operators, and the conditions stipulating its 
equality to the sum of the ranks of the addends. 

5.2.1. Prove that the set <o*y of all linear operators from a space X 
into a space Y is a linear space under the operations of addition of 
operators and multiplication of an operator by a number. 

5.2.2. Prove that the space of all linear operators on a one-dimen¬ 
sional linear space is also one-dimensional. 

5.2.3. The linear space X* of all functionals on a space X is said 
to be conjugate to the space X. Prove that the conjugate linear space 
X* is isomorphic to the space X. 

5.2.4. Show that for any subspace L of a space X, the following 
relations hold: (a) (k4) L = AL if Jl # 0; (b) ( A + B) L cr AL + 
+ BL, where A and B are operators from ca^y. Show that, generally 
speaking, the equality sign does not hold in the relation (b). 

5.2.5. Prove that nonzero operators A and B from co^y, whose 
images are different, are linearly independent. 

5.2.6. Let q lt . . ., q m be a basis for a space Y, and x a nonzero 
vector of a space X. Prove that operators B lt . . ., B m such that 

Bjx = q } , ;' = 1, . . ., m (5.2.1) 

are linearly independent. 
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5.2.7*. Prove that for any operator A from <a XT there are opera¬ 
tors B lt . . ., B m such that A = B 2 + . . . + B m whereas (a) the 
rank of each of the operators B t does not exceed unity; (b) the image 
of a nonzero operator B t is the vector q lt where q lt . . ., q m is a fixed 
basis for the space Y. 

5.2.8. Let e lt . . e n be a basis for a space X, and y be a nonzero 
vector of a space Y. Prove that the operators A lt . . ., A„ such 
that 


A } e h = 


y, k = j 
0 , k^j 


are linearly independent. 

5.2.9. Prove that any operator of rank 1 whose image contains 
a vector y is a linear combination of the operators -4 lt . . ., A n 
(see the previous problem). 

5.2.10*. Let bases e lt . . e n and q lt . . q m for spaces X 
and Y, respectively, be fixed. Using the results of Problems 5.2.7 
and 5.2.9, show that each operator from co x7 is a linear combination 
of the operators A n , . . ., A mn satisfying the conditions 


A U e h = | 


0, 


k = h 
k¥=i ' 


t = l, ..., m, / = 1, .... n. (5.2.2) 


5.2.11. By means of the results of Problems 5.2.6 and 5.2.8 show 
that a set of operators defined by relations (5.2.2) is linearly inde¬ 
pendent. Hence deduce the dimension of the space co X y (use also 
the results of Problem 5.2.10). 

5.2.12. Is the set of linear operators having (a) the same image T ; 
(b) the same kernel N, a linear subspace of the space co xr ? 

5.2.13. Show that if T is a subspace of a space Y, then the set 
(a XT of all linear operators mapping the space X into T is a subspace 
of the space (a XT . Find the dimension of this subspace if dim X = n, 
dim T = k. 

5.2.14. Show that if N is a subspace of a space X, then the set K N 
of all linear operators from w XT whose kernel contains the subspace N 
is a subspace of the space co zr . Find the dimension of this subspace 
if dim X = n, dim N = Z, dim Y = m. 

5.2.15*. Let L x and L t be arbitrary subspaces of a space Y, L = 
= Li + L t , L 0 = f) L 2 . Prove the following relations: 


( a ) WjTL = WXLi + “XL,! 

(b) <i)jtL, = WXL, f) ©XL,- 

5.2.16. Let a space Fbe decomposed into the direct sum of sub¬ 
spaces L lt . . ., Lfc. Prove that 

<0 Y y = ©XL, + ©XL, + • • • + ©XL h » 
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5.2.17. Prove that the rank of the sum of operators A and B 
from u> IY does not exceed the sum of the ranks of these operators. 

5.2.18. Let operators A and B from co zx satisfy the equality 

X = T A + T B = N A + N b . 

Prove that the rank of the operator A + B equals the sum of the 
ranks of the operators A and B. 

5.2.19. Deduce the following inequality from Problem 5.2.17 

r A+B ^ I r A — r b I* 

5.2.20*. Prove that any operator A from a> XT with rank r can 
be represented as the sum of r operators of rank 1 but cannot be 
represented as the sum of less than r such operators. 

5.2.21*. Find the necessary and sufficient condition for the sum 
of two operators of rank 1 to be of rank ^ 1. 

5.2.22*. Given that a space X has the dimension n (re > 1), 
prove that in <a XI any subspace L of dimension n + 1 contains 
at least one operator > 1. 

5.2.23. Let operators A and B from <s> XT be such that for any 
vector x from X, vectors Ax and Bx are collinear. Does this imply 
that the operators A and B are themselves collinear? 

5.2.24*. The condition that n (n = dim X) must equal the rank 
of the operator B is added to the data in Problem 5.2.23. Are the 
operators A and B collinear in this case? 

5.2.25. Prove that operators A and B of rank 1, having the same 
image T and kernel N, are collinear. 

5.2.26. Prove that for any projection operator P, the operator 
E — P is also a projection operator. Find the relation between the 
kernel and image of the operator E — P and the kernel and image 
of P. 

5.2.27. Prove that for operators P and R carrying out the projec¬ 
tion and reflection of a space X into L x parallel to L 2 , respectively, 
the following relation is valid: E + R = 2 P. 

5.2.28. Show that when a real space R is transformed into a com¬ 
plex one: (a) an operator A + B corresponds to the operator A + B 
(see 5.1.52); (b) an operator a A corresponds to the operator aA, 
a being a real number. 

5.3. Multiplication of Operators 

In the present section the following topics related to the multiplication of 
operators are scrutinized: 

(i) The image and kernel of the product of operators. 

(ii) Polynomials in operators. 

(iii) Commutativity of operators. 

(iv) Nondegenerate operators. 
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We assume in the following that the products of operators which may be on 
different spaces make sense. 

5.3.1. Prove that the product BA of operators A and B satisfies 
the inequalities: 

(a) r BA < min (r A , r fl ); 

(b) n BA ^ n A . 

If the operators A and B are defined on the same space, then 

(c) n BA ^ n B . 

5.3.2. Prove that the product BA of operators A and B satisfies 
the relations: (a) r BA = r A — dim (T A f) N B )\ (b) n BA = n A + 
+ dim (T a fl N b ). 

Note that from (b) an inequality follows: 

n BA ^ n A + n B . 

5.3.3*. Prove the Frobenius inequality : 

r BA + r AC ^r A + r bac• 

5.3.4. Let A and B be operators from © xx whereas BA = 0. 
Does it follow from here that AB = 0? 

5.3.5. Give an example of two operators A and B such that AB = 
= BA = 0. 

5.3.6. Prove that the set of all linear operators B from © xx satisfy¬ 
ing, for a fixed operator A, the condition AB = 0, is a subspace 
of the space (o xx . Find the dimension of this subspace if 
dim X = n and the rank of the operator A equals r. 

5.3.7. The same question for the set of operators C from co xx 
satisfying the condition CA = 0 for a fixed operator A of rank r. 

5.3.8. Let X be an n-dimensional space and A an operator of 
rank r from © xx . Using the operator A , construct a transformation 
of the space © xx that matches any operator B with the operator AB. 
Prove that this transformation is linear. Find its rank and defect. 

5.3.9. Let A be an arbitrary operator from © xx , and let N t and 
T t be the kernel and image of the operator A', respectively. Prove 
that 

(a) Nj c: N 2 c: N 3 a . . .; 

(b) T x =) T 2 =) T 3 => . . . . 

5.3.10*. Prove that if in the sequence of subspaces .Vj, N 2 , N 3 , ... 
(see Problem 5.3.9) for some q for the first time N q = A^, +1 , then 
Nq = N q+h for any k ^ 1. 

5.3.11. An operator A from © xx is said to be nilpotent if there 
exists a natural number q such that A q = 0. The least such number q 
is called the nilpotence index of the operator A. Prove that the index 
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of any nilpotent operator on an n-dimensional space does not exceed n. 

5.3.12. Show that the differential operator on polynomials of the 
space M„ is nilpotent. Find its index of nilpotence. 

5.3.13. Let A be a nilpotent operator of index q, and a vector x 
satisfy the inequality A 9 ' 1 ! # 0. Prove that the vector set x, Ax, 
A 2 x, . . ., .4 ,_1 x is linearly independent. 

5.3.14*. Prove that for any operator A from and with rank 1, 
there is a number a such that A 2 = aA. 

5.3.15. Show that any operator of reflection R satisfies the relation 
R 2 = E. 

5.3.16. Show that any projection operator P satisfies the equality 
P 2 = P. 

5.3.17*. Conversely, prove that any operator P satisfying the 
condition P 2 = P is a projection operator. 

5.3.18. Show that it follows from the conditions Pj + P t = E, 
P x P t = 0 that 

(a) P lf P 2 are projection operators; 

(b) P 2 P t = 0. 

5.3.19. Prove that an operator A on the space M„ which assigns 
the polynomial g (t) = / (t + 1) to any polynomial / (t) is a polyno¬ 
mial in the differential operator. 

5.3.20. Given an operator A, a polynomial f(t) (/ (f)#0) is called 
an A-annihilator if j (A) = 0. Prove that for any linear operator A 
on an n-dimensional space, there exists an .4-annihilator of degree 
< n 2 . 

5.3.21. Let m ( t ) be the polynomial of the least degree out of all 
the .4-annihilators. Prove that m (t) is a divisor of all the other 
i4-annihilators. 

5.3.22. Prove that the polynomial m(t) of Problem 5.3.21 is 
uniquely determined by the operator A depending only on a nonzero 
multiplier. Normalized so that the higher-order coefficient equals 
unity, the polynomial m(t) is called the minimal polynomial of the 
operator A. 

5.3.23*. Find the minimal polynomial (a) for a projection opera¬ 
tor; (b) for a reflection operator; (c) for a nilpotent operator of in¬ 
dex q. 

5.3.24. Show that for an operator of rank 1, the minimal polyno¬ 
mial is of the second degree. 

5.3.25. Operators A and B from (o AA - are said to be commuting 
if AB = BA. Let A commute with B, and B commute with C. 
Does it follow that A commutes with Cl 

5.3.26. Show that any two polynomials in the same operator A 
are commuting. 

5.3.27. Show that if operators A and B are commuting then any 
polynomials / (i4) and / ( B ) in these operators are also commuting. 
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5.3.28. Prove that for commuting operators A and B 
(A + B) n --=A n + nA n ~iB + n{n ~ i) A n ~ Z B* + ... + fi n . 

5.3.29. Prove that operators of rank 1 having the same kernel 
and the same image are commuting. 

5.3.30. Given two commuting operators, prove that BN A c N A . 

5.3.31*. Prove that if the projection operators P x and P 2 are 

commuting, then their product is also a projection operator. Moreover 

(») T PlPt = T Pl fl Tp,\ 

(b) N PlP , = N Pl + Np,. 

5.3.32*. Prove that the sum of the projection operators P x and P 2 
is a projection operator if and only if P 2 P t = P Z P X = 0. In addition, 

(a) T Pt+Pt =T Pl + Tp,\ 

(b) Npi+p, = Np t n Np t . 

5.3.33*. Prove that if an operator A commutes with each opera¬ 
tor from o) ix , then for any subspace L from X, AL cz L. In parti¬ 
cular, for any vector x from X, the vectors x and Ax are collinear. 

5.3.34. Using the result of Problem 5.3.33, prove the Schur 
lemma: if an operator A commutes with each operator from o) Xi 
then it is scalar, i.e. A = aE for a certain number a. 

5.3.35. Show that if ^4 is a nondegenerate operator, then for any 
subspace L, the equality dim L = dim AL holds. 

5.3.36. Given that a space X is the direct sum of subspaces 
L x , . . ., L h , and A t is a nondegenerate operator defined on the 
subspace L t , i = 1, . . ., k, show that an operator A from a» xx 
coinciding, on each of the subspaces L t , with the corresponding 
operator A t is nondegenerate. 

5.3.37. Verify that the differential operator (a) is degenerate 
on the space M n of polynomials of degree ^n; (b) is nondegenerate 
on the two-dimensional linear space generated by the functions 
/x = cos t and / 2 = sin t (under the operations of function addition 
and multiplication of a function by a number, both defined in the 
usual way). 

5.3.38. Find the inverse operator of the differential operator 
defined in Problem 5.3.37(b). 

5.3.39. Find the inverse operator of a reflection operator R. 

5.3.40. Show that for a nondegenerate operator A and any non¬ 
zero number a, 

(a A)~ l = ±A-*. 

5.3.41*. Prove that if an operator A is of rank 1, then at least 
one of the operators E + A and E — A is nondegenerate. 
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5.3.42. Prove that if an operator A is nondegenerate, then for 
any operator B, 

T AB — r BA — T B - 

5.3.43. Prove that the product of operators A and B is a non¬ 
degenerate operator if and only if each of the operators A and B 
is nondegenerate. In this case: 

(AB)' 1 = B-'A- 1 . 


5.3.44. Prove that for a nondegenerate operator A and an arbi¬ 
trary operator B, the identity is valid 

(A + B) A- 1 (A — B) = (A — B) A- 1 (A + B). 

5.3.45. Let A be a nilpotent operator of index q. Prove that the 
operator E — A is nondegenerate and that 

(E - A)- 1 = E + A +A*+ ... + A*~K 

5.3.46. Given that operators A and B are connected by a rela¬ 
tion AB + A + E = 0, prove that A is a nondegenerate operator 
while A~ l = —E — B. 

5.3.47. Prove that if an .A-annihilator has a nonzero free term, 
then the operator A is nondegenerate. 

5.3.48. Prove that the absolute term of the minimal polynomial 
m ( t ) annihilating a nondegenerate operator is nonzero. 

5.3.49. Prove that for a nondegenerate operator A on an re-dimen¬ 
sional space, the inverse operator A -1 is represented as a polyno¬ 
mial in A of a degree not greater than re* — 1. 

5.3.50. Show that any two polynomials / (i4) and g C<4 -1 ), where 
A is a nondegenerate operator, commute. 

5.3.51. Let A be an operator from and let there exists an 
operator B from o) rx such that BA — E x (the identity operator of 
the space X). Does it follow from this that AB = E 7 ? 

5.3.52. Let X be the span of polynomials t, t *, . . ., t n \ and 
let Y be the space of polynomials of degree ^ re — 1. Consider 
the differentiation of polynomials as an operator A from X into Y 
and integration (i.e. the transformation matching each polynomial 
with its antiderivative) as an operator B from Y into X. Show 
that 

BA = E z , AB = E t . 

5.3.53. Let, in addition to the data of Problem 5.3.51, dimY > 
> dim X. Prove that the operator AB is a projection operator 
on Y. 

5.3.54. Show that, when complexifying the real space R: (a) to 
operator AB there corresponds the operator AB\ (b) to a nondegene- 
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rate operator A there corresponds the nondegenerate operator A; 
(c) if A is nondegenerate then to the inverse operator A _1 there 
corresponds the inverse operator A -1 . 


5.4. Operations over Matrices 

We consider here various properties of the operations defined on matrices, 
and first of all, the operation of multiplication. Amongst the topics treated, the 
greatest weight is given to the following: 

(i) The formal properties of the operation of multiplication, viz. the 
dimensions of factors and the product; tne number of fundamental arithmetic 
operations; etc. 

(ii) Matrices of elementary transformations (or elementary matrices). 

(iii) Commuting matrices. 

(iv) Classes of matrices, closed under multiplication. 

(v) The rank of the product of matrices. 

(vi) Operations with matrices partitioned into blocks, i.e. partitioned 
matrices. 

(vii) The Kronecker product of matrices. 

Find the products AB and BA where 

5.4.1. A = (2 —3 0), £ = 13 




II 83 -29 

-52 

46 || 

111 

5.4.3. 

.4= -15 97 

78 

112 ’ 

B= K . 


|| 38 -4 

69 

85 || 

loll 



II 

83 -29 

-52 46 

5.4.4. 

,4 = ||0 1 0||, B 


-15 97 

78 -112 



II 

38 -4 

69 85 


II 5 2 “ 

3 - 

3 || 

1 

5.4.5. 

A-\\~ 7 ~ 2 
-1 2 

4 

1 


1 

1 ' 


II 2 -2 - 

3 

4 II 

1 




5 2 

-3 -3 

5.4.6. 

-4 = 111 1 1 111. 

fl = 

-7 -2 

-1 2 

4 2 

1 1 ’ 




2 -2 

-3 4 
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923 

2115 0 0 

0 

0 

0 

0 

1097 

518 0 0 

0 

0 

0 

0 

652 

769 0 0 ’ — 

476 

372 

1505 

882 

841 

134 0 0 

549 

795 

999 

400 


5.4.8*. Evaluate the product ABC of matrices 


12 

—6 -211 

1 1 1 

, B= 18 

-9 -3II 

C= 1 2 

24 

-12 -41| 

3 0 I 


II1000 1001 1002II 

5.4.9*. Evaluate the product ABCD of matrices 


A || 51| i B =|| 213 510 1281|. C = ||-l||, Z>= || 1 — 2 11|. 

5.4.10. Show that a system of linear equations 


a li x i + ®J2 X 2 + ..»+<*|n x n — &i* 
Oji^i + d 22 X 2 + . * . + &2n x n = &2* 


+ a m2 X 2 + . . . + a mn X n = 

can be rewritten in the form of a matrix equation Ax = b by intro¬ 
ducing matrices 



5.4.11. Conversely, show that the solution of a matrix equation 
AX = B, where A and B are to X re and to X p matrices, respec¬ 
tively, is reduced to the solution of p systems of linear equations 
with the same coefficient matrix A but different right-hand sides. 
Solve the following matrix equations: 


5.4.12. 

5.4.13. 

5.4.14. 

5.4.15. 
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5.4.18. Show that if hoth the products AB and BA have sense 
and A is an m X n matrix, then B is an n X m matrix. 

5.4.19. Evaluate the number of multiplication and addition 
operations in multiplying an m X n matrix A and an n X p matrix 
B together. 

5.4.20. Let A , B and C be matrices of orders m X n, n X p, 
p X q, respectively. Evaluate the number of multiplications required 
to compute the product ABC. Note that this number of operations 
depends on the place of brackets in the product ABC. 

5.4.21. Verify that for square matrices A and B of order 2, the 
procedure for computing the matrix C = AB indicated below 
requires 7 multiplication operations whereas employing the usual 
algorithm to construct AB requires 8 multiplications: 

<*i = («u + *22) (&u + M> 
a 2 = (a 2i + a tt ) b lv 
a s = a n (b X 2 — b t2 ), 
a 4 = a n {b tl — b n ), 

= ( a n + a n) b 22 , 

“a = ( a 2i — a u) (^u “H ^12)* 

«7 = ( a X2 — a 22) (^21 + ^22)> 
c u = + a t — a b + « 7 t 

c 12 = «8 + a#, 

C 21 = ®2 + ««* 
c 22 = ctj + a s — + tt 9 . 

This algorithm was suggested by Strassen. 

5.4.22. The sum of the elements on the principal diagonal of 
a square matrix is called its trace. The trace of a matrix A is denoted 
by tr A. 

Prove that the following properties are fulfilled 

(a) tr {A + B) = tr A + tr B; 

(b) tr (a A) = air A; 

(c) tr (AB) = tr (BA). 
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The last equality is also valid for rectangular matrix A and B if 
both the products AB and BA are defined. 

5.4.23. Matrices A and B of orders m X n and n X p, respec¬ 
tively, possess the property of having the same sums of the elements 
in any row, equal to r in the matrix A, and to s in the matrix B. 
Prove that the same property is possessed by the product AB, with 
the corresponding sums equal to rs. Enunciate and prove a similar 
statement for the columns. 

5.4.24. Show that the elementary row transformations of a matrix 
A (see Problem 4.1.26) are equivalent to a premultiplication of 
this matrix by special matrices, called the matrices of elementary 
transformations, that is (a) interchanging the i-th and ;-th rows 
corresponds to a multiplication by a matrix P tJ 



...0 


(the elements of the principal diagonal that are not indicated are 
equal to unity; all the other elements, except elements (i, j) and 
(/, i), are equal to zero); (b) multiplication of the i-th row by a num¬ 
ber a corresponds to a multiplication by a diagonal matrix D v 



(c) addition of the ;'-th row multiplied by a number a to the 
/-th row is equivalent to a multiplication by a matrix L tt : 


L 


</ = 


(all off-diagonal elements of this matrix, except the element (i, /), 
are equal to zero). 
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Formulate and prove similar statements for the elementary trans¬ 
formations of the columns of the matrix A. 

5.4.25. Determine how a matrix A is altered by post-multiplica¬ 
tion by (a) the matrix N t 


N, = 


(b) the matrix S t 


1 i 

S t = 1 

On I 1 

The off-diagonal elements of both matrices that are not indicated 
are equal to zero. 

A similar problem for premultiplying the matrix A by the ma¬ 
trices S t and N t . 

5.4.26. Prove that (a) the matrix N t (see the previous problem) 
is the product of matrices L hl , k = i + 1, . . ., n (see Prob¬ 
lem 5.4.24 (c)); (b) the matrix 5, is the product of matrices L hl , 
k = 1, . . ., t — 1, i + 1, . . ., tv, (c) the nontrivial elements of 
the factors L hl coincide with the corresponding nontrivial elements 
of the matrix AT, ( S t ); (d) the order of the factors in the product 
in both cases is arbitrary. 

5.4.27. Prove that the product N t N] of the matrices N t and N } 
is (when i < j) of the following form: 


N,Nj = 

vj.i 1 
a Ui. I a Ui. } 


II a nl an} 1 

(the off-diagonal elements which are not indicated are equal to 
zero). 
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5.4.28*. A square matrix P in which each row and each column 
have only one nonzero element equal to unity, is called a permuta¬ 
tion matrix. Prove that any permutation matrix is the product of 
the matrices P l} (see Problem 5.4.24 (a)). 

Evaluate the following expressions (if the order of a matrix is 
not explicit, it is equal to n ): 

5.4.29. II 1 1 || ft 5.4.30. || 1 1 || k 
|| o i || * l| 1 0 || * 



0 h 

(all the o5-diagonal elements are zero). 

X„ 



(all the elements, except the elements positioned at (i, i + 1), 
i = 1, . . ., n — 1, are zero). 



(all the elements, except the elements positioned at (1, 2), (2, 3), 
(3, 4), . . ., (n — 1, n ), ( n , 1), are zero). 

5.4.35*. Prove that for an re X re matrix 



9-0619 
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form (k ^ re): 

* ■ y 1 - ••• 

k>k-i ... n-2 Ch ^fe-n +2 

X* ... »-3c fc x fe -" +3 


II » || 

The matrix 7* is called a Jordan block corresponding to the num¬ 
ber X. 

5.4.36. Let D be a diagonal matrix of order re with all the diagonal 
elements different. Prove that (a) any polynomial in the matrix D 
will be diagonal matrix; (b) any diagonal matrix can be represented 
as a polynomial / ( D) in the matrix D ; (c) / (*) can be chosen so that 
its degree does not exceed re — 1. 

5.4.37. Prove that for any diagonal matrix of order re, the mini¬ 
mal polynomial has a degree not exceeding re. The definition of 
the minimal polynomial of a matrix is similar to the definition 
of the minimal polynomial of an operator. The latter is given in 
Problem 5.3.20. 

5.4.38. Show that the minimal polynomial of a diagonal matrix 
of order re with all its diagonal elements different is of degree re. 

5.4.39. Prove that a matrix, commuting with a diagonal matrix 
which has all its diagonal elements different, is also diagonal. 

5.4.40*. A square matrix A is called scalar if it is diagonal and 
all its diagonal elements are equal. Using the result of Problem 5.4.39 
prove the Schur lemma: if a square matrix A commutes with all 
square matrices of the same order, then it is scalar (cf. Prob¬ 
lem 5.3.34). 

5.4.41. Show that for any matrix A, the set of matrices that 
commute with A is (a) a subspace; (b) a ring. 

Find the general form of matrices that commute with the following 
matrix: 


the matrix 7* is of the 
j! X* XXk-‘ 


7* — 


5.4.42. 0 l 0 5.4.43*. 0 1 

0 0 1 . 0 1 
0 0 1 0 1 


II o|| 

(the matrix is of order re). 

5.4.44. Prove that any matrix, that commutes with a matrix A, 
will also commute with the matrix A — XE for any number X. 
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Hence deduce that the set of matrices, symmetric to a Jordan block 
/*, is the same for all h and therefore coincides with the set obtained 
in Problem 5.4.43. According to Problem 5.4.41, this set is a sub¬ 
space, determine its dimension. 

5.4.45. A square matrix A is called upper (or right-hand) triangular 
if au = 0 for i > /. Similarly, a square matrix A in which a i} = 0 
for i < /, is called lower (or left-hand) triangular. Prove that the 
product of upper (lower) triangular matrices of the same order is an 
upper (lower) triangular matrix. 

5.4.46. Find the number of multiplications necessary for the 
evaluation of the product of two triangular n-order matrices of 
the same form (i.e. both the matrices are either upper triangular 
or lower triangular). 

5.4.47. A square matrix A is called strictly upper (lower) triangular 
if a u = 0 for i > / (t ^ /). Prove that for the product B of two 
strictly triangular matrices A t and A 2 of the same form, b tJ = 0 
when i > ; — 1 (/<;' + 1). 

5.4.48. Prove that for a strictly triangular ra-order matrix A 
the power with index n is equal to the zero matrix. 

5.4.49. A square matrix A of order n + 1 is called a greenhouse 
matrix if it has the following structure 


A 


“0 
o-i 
3-2 

3-n+i 



On 

fln-i 


O-n+i O-n +2 


Oo 


Such a matrix is fully determined, therefore, by 2n + 1 numbers. 

Prove that an upper triangular matrix A is a greenhouse matrix 
if and only if it is a polynomial in the Jordan block J 0 . 

5.4.50. Deduce from the result of Problem 5.4.49 that (a) the 
product of upper triangular greenhouse matrices is also a matrix 
of the same form; (b) any two matrices of this class commute. 

5.4.51. Prove that the product of two permutation matrices is 
also a permutation matrix. 

5.4.52. A square matrix A of order n + 1 is called a circulant 
if it has the following structure 


a 0 a, a, ... a n 

4 n 3 0 a 1 ... On -2 On-i 

3n-i «n °o ■ • • On-3 a n -2 


a 2 a 3 a 4 ... a 0 a, 

31 <*2 <Js ... On a 0 


Thus, a matrix of this class is fully determined by n + 1 numbers. 
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Prove that a matrix C is a circulant if and only if it is a polynomial 
in the permutation matrix P of Problem 5.4.34. 

5.4.53. Deduce from the result of Problem 5.4.52 that (a) the 
product of circulants is also a circulant; (b) any two circulants 
commute. 

5.4.54. How many multiplication operations are sufficient to 
evaluate the product of two circulants of order ra? 

5.4.55. An n-order square matrix A is called a band matrix if for 
a certain number m (< n), all its elements a tJ , such that | i — j | > 
> m, equal zero. The number 2m + li is called the band¬ 
width. 

Prove that the product of strip matrices is also a strip matrix. 
Determine the minimum strip width of the product if the width 
of the factors equals 2 m x + 1 and 2 m 2 + 1. respectively. 

5.4.56. A square product A with nonnegative elements is said 
to be stochastic if the sum of the elements in each row of this matrix 
equals 1. Moreover, if the sum of the elements in each column equals 
unity, then the matrix is said to be doubly stochastic. Prove that (a) 
the product of stochastic matrices is a stochastic matrix; (b) the 
product of doubly stochastic matrices is a doubly stochastic matrix. 

5.4.57. Using the matrix multiplication rule prove that the rank 
of the product AB does not exceed the rank of each of the factors A 
and B. 

5.4.58. Given that annXn matrix C is the product of two rectan¬ 
gular matrices A and B of orders n X m and m X n, respectively, 
m < n, prove that the determinant of the matrix C equals zero. 

5.4.59. Prove that anniXn matrix A with rank 1 can be repre¬ 
sented as the product A = xy where x is an m X 1 matrix and y 
is a 1 X n matrix. Is such a representation unique? 

5.4.60. Let A = xy be an n X n matrix of rank 1. Prove that 
there is a number a such that A* = aA. Find an expression of this 
number in terms of the elements of the matrices x and y. 

5.4.61. Given the representations A — xy and B = uv of two 
matrices with rank 1, find the number of multiplications necessary 
to evaluate their product. 

5.4.62*. Prove that an m X n matrix A with rank r can be repre¬ 
sented as the product A = BC where B and C are m X r and r X n 
matrices, respectively. Is such a representation unique? 

The representation of a matrix A derived in Problem 5.4.62 is 
called the skeletal decomposition of this matrix. Find the skeletal 
decomposition of the following matrices: 

5.4.63. II 4 2 2 || 5.4.64. || 1 -1 2 0 || 

II 2 2 ° II . —1 2—31. 

|| 2 0 2 || || 0 1 -1 1 || 
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5.4.65. A rectangular matrix A divided by horisontal and verti¬ 
cal lines into submatrices is called a partitioned matrix. These sub¬ 
matrices are called blocks and denoted by A t f. For example, if the 
matrix A is partitioned into three “block rows” and two “block 
columns”, then it is written in the form 



Show that (a) the multiplication of a partitioned matrix by a num¬ 
ber is equivalent to the multiplication of each of its blocks by this 
number; (b) the addition of two rectangular matrices of the same 
order and partitioned in the same way is reduced to the addition of 
the corresponding blocks; (c) if A and B are two rectangular parti¬ 
tioned matrices of orders m X n and n X p, respectively, whereas 



j4,, A ,, ... A,. 


B u B t2 ... B u 

A = 

A n A„... A ls 

, B = 

B n B ti ... B it 


A ri A ri ... A rt 


B S1 B st ... B ai 


and the number of columns in each block A,j is equal to the number 
of rows in the block B Jh , then the matrix C = AB can also be repre¬ 
sented in a partitioned form 



—1.r; k= 1. t. 

This condition can be reformulated thus: the number of the columns 
of A included in each of its block columns equals the number of 
the rows of B included in the corresponding block row; (d) if A 
and B are square matrices of the same order and are similarly parti¬ 
tioned into blocks, with the diagonal blocks A tt and B tt , i = 
= 1, . . ., r, being square, then the matrix C = AB can be repre¬ 
sented in the same partitioned form, and 


= At/Bfht it k — \, ..., r. 

5.4.66. A square matrix D partitioned into blocks is said to be 
quasi-diagonal if its diagonal blocks are square, and its off-diagonal 
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blocks are zero submatrices. Show that operations over quasi-diag¬ 
onal matrices of the same block structure result in quasi-diagonal 
matrices of the same structure. Note that when quasi-diagonal 
matrices A and B are multiplied together, the diagonal blocks of 
the matrix C = AB equal the products A ii B ii of the corresponding 
diagonal blocks of the factors. Hence deduce that quasi-diagonal 
matrices A and B of the same structure commute if and only if the 
corresponding diagonal blocks are symmetric. 

5.4.67*. Find the general form of matrices that commute with 
this quasi-diagonal matrix 

X,, E ki 0 

0 x r E„ r 

(X t X, when i ;). 

5.4.68. A square partitioned matrix A is said to be quasi-triangular 
if its diagonal blocks are square, and off-diagonal blocks A t j, i> j 
(i <;) are zero submatrices. Show that operations over quasi- 
triangular matrices of the same block structure, either upper or 
lower, result in quasi-triangular matrices of the same structure. 
Note that when upper (lower) quasi-triangular matrices A and B 
are multiplied together, diagonal blocks of the matrix C = AB 
equal the products A H Bu of the corresponding diagonal blocks of 
the factors. 

5.4.69*. Using the Strassen algorithm (see Problem 5.4.21), 
indicate a method of evaluating the product C = AB of square 
matrices A and B of order 4 requiring only 49 multiplication opera¬ 
tions (compared with 64 operations in the customary method). 

5.4.70. Let A be a complex re-order matrix. Represent A as A = 
= B + iC where B and C are real matrices, and assign to it a real 
matrix D of order 2re, viz. 



Show that if A x and A 2 are complex re X re matrices, and D x and D 2 
are real double-order matrices made up in the indicated way, then 
the product A X A 2 corresponds to the product D X D 2 . Note that in 
the particular case where re = 1 the correspondence between the 
complex numbers z — x + iy and the real matrices of order 2 of 
the form 



is obtained. 
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5.4.71. Let a complex column vector z 0 of order re be a solution 
to a system of linear equations Az = b where A is a complex m X n 
matrix and b is a complex column vector of order m. Represent 
A, b and z 0 as A = B + iC, b = / + ig, z 0 = x 0 + iy 0 , where B 
and C are real matrices; /, g, x 0 , y 0 are real column vectors. Show 
that the real column vector 



of order 2ra is a solution to the system of 2m equations with real 
coefficients Du = d, where 



5.4.72. Show that the transposition operation is related to the 
other operations on matrices by the following properties: 

(a) (aA)T = aA T ; 

(b) (A + Bp = AT + B T ; 

(c) ( AB)* = BTA T . 

5.4.73*. Let A and B be rectangular matrices of orders m X n 
and p X q, respectively. A matrix C of order mp X nq that can 
be represented in a block form as 



° n B 

a lt B . 

• Oi nB 

c= 

a u B 

a tt B . 

. o tn B 


*m\B 

a mt B .. 

« *mn^ 


is called the Kronecker product A X B of the matrices A and B. 

Prove that for the Kronecker product of matrices the following 
is valid: 

(a) (a A) X B = A X (a B) = a (A X B)\ 

(b) (A + B) X C = A XC + B X C; 

(c) A X (B + C) = A X B + A X C; 

(d) if the products AB and CD are defined, then 

(AB) X (CD) = (A X C)(B X D); 

(e) the matrix A X B can be reduced to the matrix B X A by 
interchanging its rows and columns; moreover, if A and B are square, 
then the rows and columns undergo a similar interchange. 

5.4.74. Show that the representation of a matrix A of rank 1 as 
the product A = xy (see Problem 5.4.59) can be interpreted as 
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a representation of A as the Kronecker product 
A = y X x. 

5.4.75*. Let e lt . . ., e m be a basis for the space of column vectors 
of order m (i.e. m X 1 matrices), and f lf a basis for the 

space of row vectors of order n (i.e. 1 X n matrices). Prove that the 
Kronecker products j } X e t produce a basis for the space of m X n 
matrices. 

5.4.76. Prove that the Kronecker product of square matrices A 
and B, perhaps, of different orders, is (a) a diagonal matrix if A 
and B are diagonal; (b) an upper (lower) triangular matrix if A 
and B are upper (lower) triangular; (c) a stochastic (doubly sto¬ 
chastic) matrix HA and B are stochastic (doubly stochastic). 

5.4.77*. Let A and B be square matrices of orders m and n, respec¬ 
tively. Prove that 

(a) tr (A X B) = (tr A) (tr B); 

(b) det (A X B) = (det A) n (det B) m 

5.4.78. Let A, B, and C be rectangular matrices of orders m X n, 
p X q and m X g, respectively. Consider the matrix equation 
A X B = C, where X is an n X p matrix, as a system of mq linear 
equations in the np unknown coefficients of this matrix, numbered 
as follows: 


X ll* *1*» • • •* x ipi x 21 , x 22 , . . ., x tp , . . ., x nl , x n2 , . . ., x nP . 

The equations of the system are numbered in accordance with the 
familiar “by row” numeration of the coefficients in the matrix C: 

C ll* C 12i • • •* c lqi C 21' ^22» • • •» < ’2q» • • •» c ml> c m 2* • • •» c mq’ 

Prove that this system of linear equations has A X B T as its matrix. 

If, however, the coefficients of the matrices X and C are numbered 
by column, i.e. 

*111 X 2H • • •! ^nli ^Ji *22* • • x rnt • • •» ^lpt x ipi • • •» x npi 

C llt C 2 H • • •» c mi» c 12» C 121 • • •» e ra!i • • *1 c lqt c 2 qt • • •» c mq i 

then the system has B T X A as its matrix. 

5.4.79. Show that if a matrix equation 
AX + XB = C, 

where A, B and C are mX m, nX n and mX n matrices, respective¬ 
ly, is considered as a system of linear equations in the coefficients 
of the m X n matrix X, then the matrix of this system is given by 
the following: (a) A X E n + E m X B T if the coefficients of the 
matrices X and C are numbered by row; (b) E n X A + B T X E m 
if the coefficients of the matrices X and C are numbered by columns. 
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5.4.80. Given that the elements of an m X n matrix A are real 
differentiable functions of a real variable t, an m X n matrix dA/dT 



da„ 1 

da 12 

da, „ 


dt 

dt ' 

dt 

dA 

dt ~ 

da 2 1 

da 22 

da^n 

dt 

dt 

dt 


da m , 

dttmi 

damn 


dt 

dt " 

“ dt 


is called the derivative of the matrix^. 

Prove that for the differentiation of matrices so defined the fol¬ 
lowing relations are valid: 

(.)•£(«*)-«"-! 

Mw <">-■! r B + AJ TT-’ 

wiue>-&) T . 


5.5. The Inverse of a Matrix 

In this section various techniques to evaluate the inverse matrix and the 
forms of the inverse matrices in the cases of some frequent classes of 
matrices are indicated. Just like in Sec. 5.4, great attention is paid to the 
matrices of the elementary transformations and to partitioned matrices. At 
the end of the section we provide problems on the nse of the Binet-Cauchy 
formula. 


Using explicit expressions of the elements of A~ l in terms of 
elements of A , evaluate the inverse matrices of the following: 


5.5.3. II « -b 


L + 0. 


5.5.2. 

5.5.4. 


|| cos a —sin a II 
|| sins cosa||* 


ad — be 0. 


5.5.5. -2 3 1 

3 2 

1 2 1 



2 

2 


5.5.7. 


-3 -1 
7 2 

2 -4 


1 —1 li 
1 —2 | . 

0 
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5.5.9. 

0 111 

—10 11 

5.5.10. 

1110 

-12 10 


—1—1 01 

—1 —1 —1 0 


14 10 

0 0 0 3 


5.5.11. II 3 2 1 2 II 5.5.12* 

7 5 2 5 

°° 9 4 ' 

II 0 0 11 5 | 

5.5.13. Prove that the set of matrices of the form 


. « 2 + 6 2 + 
\\c* + d*J= 0. 


|| cos a —sin a || 

|| sin a cos a || ’ 

where a is any real number, forms a commuting group under multi¬ 
plication. 

5.5.14. Prove that the set of real matrices of the form 

II: II 

has the structure of a field with respect to the usual operations of 
addition and multiplication of matrices. Show that the correspon¬ 
dence between such matrices and the complex numbers 

I: 

is one-to-one and preserves the operations. 

5.5.15*. Prove that the set of real matrices of the form 
abed 
—b a —d c 

—c d a —b 

-d —e b a 

has the structure of a ring with respect to the usual operations of 
addition and multiplication of matrices. 

Prove that nonzero matrices of the indicated form is a group 
(noncommuting) under multiplication. 

5.5.16*. Can a set of matrices in which (a) all matrices are dege¬ 
nerate; (b) there are both degenerate and nondegenerate matrices, 
he a group under multiplication? 

5.5.17*. Prove that the matrix, inverse to an upper (lower) trian¬ 
gular matrix, is also upper (lower) triangular. Hence, using the 
result of Problem 5.4.45, deduce a corollary: the set of nondegenerate 
triangular matrices of the same form is a group under multiplication. 

5.5.18*. Prove that the matrix, inverse to a greenhouse triangular 
matrix, is also a greenhouse triangular matrix of the same form. 
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Hence, with the aid of the result of Problem 5.4.50, deduce a corol¬ 
lary: the set of nondegenerate greenhouse triangular matrices of the 
same form is a group under multiplication. 

5.5.19*. Prove that the matrix, inverse to a circulant, is also 
a circulant. Bearing in mind the result of Problem 5.4.53, deduce 
the following corollary: the set of nondegenerate circulants is a group 
under multiplication. 

5.5.20*. In a nondegenerate matrix A the sum of all row elements 
is the same for all the rows. Prove that the inverse matrix A~ l 
possesses the same property. Moreover, if the row sum equals r# 0 
for the matrix A, then they are equal to 1/r for A' 1 . 

Enunciate and prove a similar statement for the columns. 

5.5.21. Prove that (a) the set of nondegenerate stochastic matri¬ 
ces, (b) the set of nondegenerate doubly stochastic matrices, are 
groups under multiplication. 

Find the inverse matrices of the following matrices of order n: 


5.5.22. 

K 

0 

5.5.23. 

0 

X, 






X 



0 

x n 



Xn 

0 

(all are different from zero). 



5.5.24. 

i 

-1 0 

... 0 

1 5.5.25. 

1 


0 

1 -1 

... 0 



0 


0 

0 1 

... 0 



0 


0 

0 0 

... 1 



0 

5.5.26. 

1 

0 0.. 

0 0 I 

5.5.27*. 1 

a 


a 

1 0 .. 

0 0 



0 i 


0 

a 1 .. 

0 0 



0 1 


0 

0 0.. 

a 1 1 



0 1 

5.5.28. 

1 

2 3.. 

n 





0 

1 2 .. 

n — 1 





0 

0 1.. 

n — 2 





0 

0 0.. 

1 





5.5.29. Find the inverse matrices to the matrices of elementary 
transformations P t j, D t and L l} (see Problem 5.4.24). 

5.5.30. How is the inverse matrix A~ l altered if in the matrix A 
(a) the i-th and /-th rows are interchanged; (b) the i-th row is multi¬ 
plied by a nonzero number a; (c) the /-th row premultiplied by 
a number a is added to the i-th row? 












140 


Linear Operators and Matrices 


Answer the similar questions for the columns of A. 

5.5.31. Find the inverse matrices of the matrices N t and S t (see 
Problem 5.4.25). 

5.5.32. Prove that for a nondegenerate matrix A of the form 



the inverse matrix B = A' 1 is of the form 

b lt l >it -.-fci.n-i b tn 

b u b n ... b t ,n- t 0 

5 = .. 

bn-n i b n . t , , ... 0 0 

6 „, 0 ... 0 0 

5.5.33. Prove that the matrix, inverse to a permutation matrix, 
is also a permutation matrix. Show that the set of permutation 
matrices of a given order re is a group under multiplication. Find 
the number of elements in this group. 

5.5.34. Show that the evaluation of the matrix, inverse to an 
re X re matrix A, can be reduced to the solution of re systems of 
linear equations, each of which consists of re equations in re unknowns 
and has the matrix A as its coefficient matrix for the unknowns. 
Compare the number of arithmetic operations needed in solving 
such systems by the Gauss method with that in finding the inverse 
matrix using the explicit expressions for its elements in terms of 
the elements of A. 

Find the inverse matrices of the following by the method indicated 
in Problem 5.5.34: 


5.5.35. 2 3 4 

5 5.5.36. 1 

—2 2 

—4 

12 3 

4 —2 

3 -4 

6 

1 1 2 

3 ’ 3 

-6 5 

—10 

1 1 1 

2 —6 

9 —10 

15 


5.5.37*. All the leading principal minors of an re X re matrix A 
are nonzero. Prove that using the Gauss method the matrix A can 
be represented as the product of a lower triangular matrix L by 
an upper triangular matrix R, i.e. A = LR. The diagonal elements 
of one of these matrices can be set equal to unity. 

5.5.38. Prove that the representation of a matrix A as the product 
A = LR, obtained in Problem 5.5.37, is unique if the diagonal 
elements of the matrix L are chosen to be equal to unity. 
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5.5.39. Prove that any nondegenerate matrix A can be represented 
as the product A = PLR, where P is a permutation matrix, L is 
a lower triangular, and R is an upper triangular matrix. 

5.5.40*. Prove that any nondegenerate matrix A can be reduced 
to the unit matrix by elementary transformations of its rows and 
columns. 

5.5.41. Show that the statement of Problem 5.5.40 is valid even 
if only elementary transformations of the rows (columns) are permit¬ 
ted. 

5.5.42. Using the result of Problem 5.5.40, prove that any non¬ 
degenerate matrix can be represented as the product of matrices 
of elementary transformations. 

5.5.43. Show that if elementary row transformations by which 
a given matrix A is reduced to the unit matrix are applied in the 
same sequence to the rows of the unit matrix, then the resulting 
matrix is the inverse A~ l . 

Find the inverse matrices of the following by the method indicated 
in Problem 5.5.43: 


2 3 2 2 

5.5.45. 

2 3 4 5 

_1 —1 0 -1 


3 3 4 5 

—2 —2 -2 —1 


4 4 4 5 

3 2 2 2 


5 5 5 5 


5.5.46. Let /„ be a matrix of order n all of whose elements are 
equal to unity. Prove that 

(E—J n )-i = E- T ^ T J n . 

5.5.47. Let B be a matrix of rank 1. According to Problem 5.4.60, 
B * = aB for some number a. Assuming that a =£ —1, prove that 

(E + B)- 1 = E-$B, 

where P = ^ ^ — . Show that Problem 5.5.46 is a particular case 
of this statement. 

5.5.48. Show that if a matrix A is nondegenerate, then the matri¬ 
ces A + B and E + A -1 B are either both degenerate or both non¬ 
degenerate. 

5.5.49*. Let A be a nondegenerate matrix whose inverse A -1 
is known; further, let B = xy be a matrix of rank 1. Prove that 
if the matrix A + B is nondegenerate, then its inverse can be found 
by the formula 

(A + B)- 1 = A- 1 - PA ~ l BA -1 

where P =^- ^_ a , a = yA~ l x. Thus, if a matrix of rank 1 is added 
to the matrix A, then a matrix of rank 1 is also added to the inverse 
matrix. 
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5.5.50. Calculate the number of multiplications and divisions 
necessary to transform A~ l to (A + Z?) -1 in Problem 5.5.49, as¬ 
suming that the matrices x and y that make up the matrix B are 
known. 

5.5.51. A number y is added to an element a u of a nondegenerate 
matrix A yielding a matrix A which is also nondegenerate. Find an 
expression for A -1 in terms of y and the elements of the matrix A' 1 . 

5.5.52. In a nondegenerate matrix A of order n, the elements 
Yu .... Yn are added to the last row in such a way that the non¬ 
degeneracy of the matrix is preserved. Find an expression for the 
inverse of the new matrix A, in terms of the elements of A' 1 and 
the numbers Yi> Y 21 • • • > Yn- 

5.5.53. A number a is added to each of the elements of a non¬ 
degenerate matrix A. The obtained matrix A will still be non¬ 
degenerate. Find an expression for A _1 in terms of the elements of 
A' 1 and the number a. 

Find the inverse matrices to the following matrices of order n: 


5.5.54. 


5.5.55. 


a b b ... b 

b a b ... b 

b b a ... b 


b b b ... a 

0 1 1 ... i 

1 0 i ... 1 

1 1 0 ... 1 


a^b, 

a # b (1 — n). 


1 1 0 ... 1 


1 ... 1 
1 ... 1 
1 -Ms--. 1 


1 ... l + a n 


(all a, are nonzero). 

5.5.58. Prove that the inverse of a nondegenerate quasi-diagonal 
matrix D is also quasi-diagonal and has the same block structure 
as D. Note that the diagonal blocks of D~ l are the inverse matrices 
of the corresponding diagonal blocks of D. 

5.5.59. Prove that the inverse matrix of a nondegenerate upper 
(lower) quasi-triangular matrix A is also upper (lower) quasi-triangu- 
lar and has the same block structure as A. Note that the diagonal 
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blocks of A~ x are the inverse matrices of the corresponding diagonal 
blocks of A. 

5.5.60. Find the inverse to the matrix A of order k + l 


5.5.61*. Let the submatrix A of the following square partitioned 
matrix 


A B II 

C D || 


be square and nondegenerate. Prove that the determinant of ths 
matrix M satisfies the relation 


| M | = | A || D - CA-'B |. 


5.5.62*. The inverse matrix An l -\ of a matrix A n _ x of order n — 1 
is known. Find the inverse to the enclosing matrix A n of order n 



assuming it to be nondegenerate. 

5.5.63. Calculate the number of multiplications and divisions 
necessary to employ the formulae for AJ derived in Problem 5.5.62. 

5.5.64. Verify that the inverse matrix M -1 of the square parti¬ 
tioned matrix M of order k + l 



where A and D are square blocks of orders k and Z, respectively, is 
also partitioned, viz., 


where P = (A - BD~ x C )~ l , Q = -PBD~ X , R = - D~ X CP , S = 
= D- 1 -D-'CQ or 

S = (D - CA- x B)-\ R = -SC.4- 1 , 
p = a -‘ - A' l BR, Q = -A-'BS. 

The inverse matrices indicated here are assumed to be defined. 
These so-called Frobenius formulae make it possible to reduce the 
evaluation of the inverse to a matrix of order k + l to the computa¬ 
tion of one matrix of order k and one matrix of order 1. 

5.5.65. Let A and B be square nondegenerate matrices of orders 
m and n, respectively. Prove that the Kronecker product of these 
matrices is also nondegenerate and that 

(A X B)- 1 = A- 1 X B-K 
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Find the inverse matrices to the following 
5.5.66. II 1 0 0 0 0|| 

0 10 0 0 

83 — 47 1 0 O ' 

— 55 94 0 1 0 

|| 62 — 71 0 0 11| 


5 . 5 . 67 . || 0 0 0 1 - 11 | 

0 0 10 2 

0 1 0 0 2 < 

1 0 0 0 1 

111 -2 4 1 5II 

5 . 5 . 68 . || 1 0 3 911 

(0 17 21 

-3 -12 < 0 * 

II 1 4 0 l|| 


5.5.69.* 24 32 9 12 

40 56 15 21 
15 20 6 8 

25 35 10 14 


5.5.70. Let A = B + iC be a complex matrix of order n, and 
A" 1 = F + iG be the inverse of A. Prove that the real matrices of 
order 2 n, i.e. 

B —C 
C B 

and 

F -G 
G F 

are inverse to one another. 

5.5.71. Prove that the operations of transposing and finding 
the inverse are commuting, i.e. (.4 r ) _1 = ( A~ l ) T . 

5.5.72. The elements of a square matrix A are differentiable 
functions of a real variable t. Assuming that the matrix A is nonde¬ 
generate for a given value of t, prove the formula: 


5.5.73. Show that the solution of a system of linear equations 
Ax — b with a nondegenerate square coefficient matrix A is x = 
= A~ l b. Hence deduce Cramer’s formulae. 

5.5.74. Let the coefficients of the matrix A and column vector b 
(seeJProblem 5.5.73) be differentiable functions of a real variable t. 
Prove the formula 




db_ 
dt * 


5.5.75. Let A and B be rectangular matrices of orders m X n 
and n X p, respectively. Prove that the minors of the matrix C = AB 
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satisfy the relations: 

c( l : ! 2 - !*)= s 


/i, I. 


*, - " ;; 
(l<i t <i 2 < ... l<; 1 </ 2 < •• • <]q<p)- 


5.5.76. Using the Binet-Cauchy formula, prove that the rank of 
each of the matrices AA T and A T A equals the rank of the matrix A. 
A is assumed to be a real matrix. 

5.5.77. Prove that the sum of all the principal minors of a given 
order k (1 ^ k ^ min ( n, m)) of the matrices AB and BA, where A 
and B are rectangular matrices of orders m X n and n X m, respec¬ 
tively, is the same. 

5.5.78. A square matrix A is said to be totally nonnegative (totally 
positive) if all minors of each order are nonnegative (positive). 
Prove that the product of totally nonnegative (totally positive) 
matrices is also a totally nonnegative (totally positive) matrix. 

5.5.79*. Let A be a square matrix of order n. Given a natural 
number p, 1 < p < n, list in lexicographic order all the N = n C p 
combinations of n numbers 1, 2, . . ., n taken p numbers k x < 

< & 2 < ... < k p at a time. Lexicographic order means that the 
combination k x < k t < . . . < k p precedes the combination k' < 

< < ... < k p if k t = k[, . . ., k\. x = but k, <k' h 1 < 

< l < p. Construct the square matrix A p = (<*</,p) of order N as 
follows: 


a U.i 


\/i ft 


if the number of the combination i x < i 2 < ... < ip equals i, 
and the number of the combination j x <j * < ... < j p equals /. 
The obtained matrix A p is termed the p-th associated with A. In 
particular A x = A, A n = | A |. 

Prove that 


( a ) (^n)p = ENt 

(b) an associated matrix with a diagonal matrix D is also diago¬ 
nal; (c) an associated matrix with an upper (lower) triangular matrix 
A is also upper (lower) triangular; 

(d) (AB) P = A P B P , 

(e) if A is a nondegenerate matrix then (A -1 ) p = (A p ) _1 . 
5.5.80*. Let A be a nondegenerate matrix of order n. Prove that 

the minors of any order of the inverse matrix B = A~ l are related 
to the minors of the matrix A by the relations 

p 


2 
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whore i x < i , < ... < i p along with i' < i' < ... < i,\. p . and 
k x < k t < ... < k p along with Ar' < A*’ < ... < k!,. p make the 
complete system of indices 1,2,.. .. n. 

5.6. The Matrix of a Linear Operator, 

Transfer to Another Basis, 

Equivalent and Similar Matrices 

These problems are in three groups corresponding to the topics in the section 
heading. 

5.6.1. The Euclidean plane E t is assumed to have a right-hand 
orientation (i.e. positive angles are those measured counterclock¬ 
wise). Let Oe x e t he a dextral Cartesian system of coordinates on the 
plane E t . Construct the matrix of a linear transformation consisting 
in the rotation of E 3 through an angle a about the origin for the 
basis e x , e t . 

5.6.2. Let e x , e 2 , e 3 be a dextral orthonormal basis for the three- 
dimensional Euclidean space E 3 of geometric vectors. Consider the 
following linear operator A of the space E 3 

Ax = [x, a\. 

Here a is a fixed vector whose coordinates with respect to the basis 
e lt e 2 , e 3 are equal to a, p, y. Find the matrix of the operator A 
in this basis. 

5.6.3. Write the matrices of: (a) the differential operator; (b) the 
difference operator A x ; in the space M„ of polynomials of degree 

with respect to the basis 1, t, t 2 , . . t n . 

5.6.4. If the differential operator is an operator from M n to M„. x , 
write its matrix with respect to the two bases 1, t, t 8 , . . ., t n 
and 1, t, t 2 , . . ., r-». Find the matrix of the integration operator 
with respect to the two bases as if it were an operator from M 

to M„. 

5.6.5. Find the matrix of the differential operator on the two- 
dimensional linear space drawn on the basis functions 

( a ) A (0 = cos L /* (0 = sin 

(b) g\ ( t) = e at cos bt, g t ( t) = e al sin bt. 

5.6.6. A space X is the direct sum of subspaces L, and L t . A ba¬ 
sis e x , . . ., e„ is selected so that the vectors e lt . . ., e T form a basis 
for the subspace L x and e r+1 , . . ., e„ form a basis for L t . Using 
the basis e x , . . ., e„, construct (a) the matrix of the operator that 
projects onto L x , parallel to L 2 , (b) the matrix of the operator that 
projects onto L t , parallel to L x ; (c) the matrix of the operator that 
reflects in L x parallel to L z . 
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5.6.7. Consider the re-dimensional arithmetic space X (either real 
or complex) and the corresponding m-dimensional arithmetic space Y 
where the “natural” (standard) bases, made np of the unit vectors 
of those spaces, are used. We can match each m y re matrix A with 
an operator A from X to Y when the operator is defined as follows: 

£ -h<- 1 / = Ar, 

i.e. each column vector x from X is multiplied by the matrix A. 
Prove that (a) this correspondence between the m X re matrices 
and the operators from X to Y is one-to-one; (b) the matrix of the 
operator A with respect to the two standard bases coincides with 
matrix of A. Thus, the operators on arithmetic spaces can be identi¬ 
fied with rectangular matrices of the corresponding orders. 

5.6.8. An operator A on a three-dimensional arithmetic space 
converts linearly independent vectors a 2 , a 2 , a 3 into vectors b lt b 2 , b 3 , 
where 



Find the matrix of this operator (a) with respect to the basis a lt 
a t> a 3 ; 

(b) with respect to the standard basis e lt e 2 , e 3 . 

5.6.9. In the space of square matrices of order 2 a basis consisting 
of matrices (in the order indicated) 



is fixed. Write with respect to this basis (a) the matrix of the transpo¬ 
sition operator, i.e. the operator that assigns to each matrix X 
its transpose; (b) the matrix of the operator G AB that assigns to 
each matrix X the matrix AXB where A and B are given matrices; 
(c) the matrix of an operator F AB defined by the relation 

X -+AX + XB. 

How are these matrices altered if in the basis the matrices 

IPHIMI 

are interchanged? 

5.6.10. Let in the space of m X re matrices a basis E u , E 12 , . . . 
• • -t F ln , E 2 1 , E 2 j, . . ., E 2n , . . ., E m i, E 7712) • • •, E mn (in the 
order indicated) be fixed, E l} being an m X re matrix in which the 
only nonzero element is placed at (t, /') and is equal to 1. Further, 
let A and B be given square matrices of orders m and n, respectively. 
10* 
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Consider the operators G AB and F AB , defined by the relations 
X—^AXB, 

F.„ 

X—-Z+AX + XB. 

Prove that with respect to the indicated basis (a) the matrix of 
the operator G AB is the Kronecker product A X B T ; (b) the matrix 
of the operator F AB is A X E„ -r E m X B T . 

Find matrices of the same operators with respect to the basis 
^■ll> ^2H • • M ^mii ^12* ^22< • • -i F mi , . . ., E ln , E in , . . ., E m „. 

5.6.11. Let A be an operator from c i XT . Prove that all the matri¬ 
ces defining the operator A with respect to various pairs of bases 
for the spaces X and Y have the same rank equal to the rank of A. 

5.6.12. Find the rank of an operator F AB 



5.6.13. Prove that the operator F AU (see Problem 5.6.12) is 
dilpotent and find the nilpotence index of this operator. 

5.6.14. What can be said about the matrix of an operator A of 
rank r if, in the basis e lt . . ., e„ of the space X, the vectors e r+1 . . . 
. . ., e„ belong to the kernel of this operator? 

5.6.15*. An operator A from ©jfy has rank r. Prove that in the 
spaces X and Y, the respective bases e u . . ., e„ and q v . . ., q m 
can be chosen such that the matrix A qe of the operator A is of the 
form 

1 0 ... 0 0 ... Oil 
0 1 ... 0 0 ... 0 

00... 10... 0' (3.6.1) 


0 0 ... 0 0 ... 0 || 

The number of nonzero columns in the matrix A qe equals the rank r 
of the operator. 

5.6.16. Show that any real or complex nondegenerate matrix 
of order n can be regarded as the matrix that defines in the ra-dimen- 
sional space X, respectively real or complex, the transfer from one 
basis e lt . . ., e„ to another, f lt . . ., /„; moreover, one of the bases 
can be chosen arbitrarily. 

5.6.17. Let a matrix A define the transfer from a basis e lt . . ., e n 
to a basis/j, . . ., /„, and a matrix B from / x , . . ., /„tog x , . . ,,g„. 
Show that (a) the transfer matrix from j x , ...,/„ to e lt . . ., e„ 
is A- 1 ; (b) the transfer matrix from e u . . ., e„ to g v . . ., g n 
is C = AB. 
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5.6.18. How is the transfer matrix from e lt . . e„ to f lt . . ., /„ 
altered if (a) the vectors e t and ej are interchanged? 

(b) the vectors /* and are interchanged? 

5.6.19. An operator A is defined with respect to the basis 1, t , t % 
in the space M 2 , by the matrix 

FI 

111 o oil 

Find the matrix of this operator when the basis comprises the poly¬ 
nomials 3 1 % + 2 1, 51* + 3t + 1, 71* + 51 + 3. 

5.6.20. Two operators are defined on the space M a . The operator A 
transforms any polynomial a 0 + a x t 4- a 2 t* + a 3 t s into the polyno¬ 
mial a 0 + a x t + a 2 t 2 . The operator B transforms the polynomials 
l 3 + 1*, l 3 + 1, I s + 1, I s + 1* + 1 + 1 into l 3 + 1, I s + 1, l 3 + 
+ 1* — 1 + 1 and the zero polynomial, respectively. Construct the 
matrices of the operators AB and BA with respect to the basis 
1, 1, 1*, l 3 . 

5.6.21. Let P and Q be nondegenerate matrices of orders m and n, 
respectively. Show that matrices F xx , F X2 , . . ., F ln , F 2X , F 22 , . . . 
■ ■ ■, F mn (where F tJ = PE t jQ, and E tJ are the matrices defined 
in Problem 5.6.10) form a basis for the space of m X n matrices. 
Find the transfer matrix from the basis made up of the matrices E t j 
to this basis, and also the matrix of the inverse transfer. 

5.6.22. Find the matrices of the operators G AB and F AB of Prob¬ 
lem 5.6.10 with respect to the basis F n , F 12 , . . ., F mn (see Prob¬ 
lem 5.6.21). 

5.6.23. Let A 2 be an operator defined by a square n X n matrix A 
with respect to a basis e x , . . ., e„ of a space X, A 2 the operator 
defined by the same matrix with respect to a basis f x , . . ., /„. 
Prove that 

where P is an operator transforming the vectors e v . . ., e„ into 

fl . fn- 

5.6.24. Rectangular matrices A and B are said to be equivalent 
if there exist nondegenerate matrices R and S such that B = RAS. 
Show that the equivalence relation on the sot of rectangular matrices 
of fixed order m X n is reflexive, symmetric, and transitive. 

5.6.25. Square matrices A and B are said to be similar if there 
exists a nondegenerate matrix P such that B = P~ X AP. In addition, 
the matrix P is said to transform A to B. Show that the similarity 
relation on a set of square matrices of a given order n is reflexive, 
symmetric, and transitive. 
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5.6.26. Prove that any two equivalent (similar) matrices have 
the same rank. 

5.6.27. Let X and Y be an n-dimensional and m-dimensional 
space, respectively. Prove that any two equivalent m X n matrices 
A and B can be regarded as matrices defining the same operator 
from o) Yy with respect to certain pairs of bases e x , . . ., e n , q v . . . 
. . ., q m , and / 1? . . ., /„, t x , . . ., t m of these spaces. One of the 
pairs of bases can be chosen arbitrarily. 

5.6.28. Prove that any two similar matrices of order n are matrices 
that define the same operator of an n-dimeusional space X with 
respect to two bases e„ . . ., e„ and f x , . . ., /„ for this space. 
The choice of one of the bases is arbitrary. 

5.6.29*. Prove that any matrix A is equivalent to a matrix of 
form (5.6.1). 

5.6.30. Prove the statement, converse to that in Problem 5.6.26, 
viz., two m ' n matrices A and B having the same rank are equi¬ 
valent. 

5.6.31. Let matrices A and B be similar, i.e. B — P~ X AP. Is 
the transforming matrix P unique? 

5.6.32*. Show that a scalar matrix aE is similar only to itself. 
Prove that this property is intrinsic only to scalar matrices. 

5.6.33. Let A be a fixed square matrix. Prove that the set of 
all matrices P transforming A into A is a group under multipli¬ 
cation. 

5.6.34. Let A and B be similar matrices. Prove that if P 0 is some 
matrix that transforms A into B, then the whole set of the trans¬ 
forming matrices is obtained from the set of the matrices transform¬ 
ing A into A by multiplying the latter matrices on the right by the 
matrix P 0 . 

5.6.35. Show that a matrix A is transformed into a similar matrix 
by the following procedure: (a) the i-th row is multiplied by a non¬ 
zero number a and then the i-th column is multiplied by the num¬ 
ber 1/a; (b) the ;-th row is multiplied by a number a and added to 
the i-th row; then the i-th column premultiplied by a is subtracted 
from the /-th column; (c) the t-th and /-til rows, and then the i-th 
and y-th columns are interchanged. 

5.6.36*. Show that the mirror reflection in the centre of a square 
matrix is a similar transformation of this matrix. 

5.6.37. Prove that similar matrices A and B have the same trace 
and determinant. 

5.6.38. Prove that if at least one of two square matrices A and B 
of the same rank is nondegenerale, then the matrices AB and BA 
are similar. Give an example of degenerate matrices A and B for 
which AB and BA are not similar. 

5.6.39. Show that if matrices A and B are similar, then (a) the 
matrices A 2 and B 2 are similar; (b) the matrices A h and B h , where k 
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is any natural number, are similar; (c) for any polynomial / ( t), 
the matrices f (A) and / (B) are similar. 

5.6.40. Does the equivalence of matrices A and B of order n X n 
mean that the matrices A 2 and B 2 are equivalent (cf. Problem 5.6.39 
(a))? 

5.6.41. Show that similar matrices A and B have the same mini¬ 
mal polynomial. 

5.6.42. Matrices A and B of orders m and n, respectively, are 
similar to matrices C and D. Prove that (a) the matrix A X B is 
similar to the matrix C X D\ (b) the matrix A X E n -p E m X B T 
is similar to the matrix C X E„ + E m X D T . 

5.6.43. Prove that if matrices A and B are similar, then their 
associated matrices A p and B p are similar. 

5.6.44. Show that if the complex matrices A x = B x -j- tCj and 
A 2 = 5 2 + iC 2 are similar, then the real matrices Dj and D 2 are 
also similar: 
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6.0. Terminology and General Notes 

Let A be an operator from A number X 
is called an eigenvalue of the operator A if a nonzero vector x exists 
such that 

Ax = X*. (6.0.1) 

Any vector x=fc0 satisfying (6.0.1) is called an eigenvector of the 
operator A associated with the eigenvalue X. 

If A e is the matrix of an operator A with respect to an arbitrary 
basis e x , . . ., e n for the space X then the polynomial det (X£ — A) 
does not depend on the selection of the basis and is called the charac¬ 
teristic polynomial of the operator A. 

The roots (in the given field) of the characteristic polynomial, and only 
the roots, are the eigenvalues of an operator. 

According to the fundamental theorem of algebra, any polynomial 
of degree n (n ^ 1) with complex coefficients has precisely n roots 
in the field of complex numbers (if each is counted as many times 
as its multiplicity). If the algebraic multiplicity of an eigenvalue is 
defined to be equal to its multiplicity as a root of the characteristic 
polynomial, then 

in a complex linear space of dimension n, each operator has n eigen¬ 
values (taking their multiplicity into account). In addition, there 
exists at least one eigenvector. 

A subspace L is said to be invariant with respect to an operator A 
if from x £ L it follows that Ax 6 L. An operator A, considered 
only for vectors from an invariant space L, is called an induced 
operator and denoted by AIL. 

If a space X is the direct sum of subspaces L 2 and L 2 , invariant 
with respect to an operator A, then for any vector x with the decom¬ 
position 

x = x 1 + x 2 , x 2 6 L lt x 2 6 L 2 , 

we obtain 

Ax = Ax 2 + Ax 2 = (A/L^ x 2 + (A/L 2 ) x 2 , 

whereupon the operator A is said to be the direct sum of the induced 
operators AIL X and A/L 2 . This is equivalent to saying that the 
operator A is reduced by the pair of subspaces L 2 and L 2 . 



6.1 


Eigenvalues and Eigenvectors 


153 


For any operator A on a complex space, there exists a basis for 
this space, called a Jordan canonical basis, in which the matrix 
of this operator is of quasi-diagonal form 


0 


0 

Jh 


where each of the diagonal blocks J t is a Jordan block corresponding 
to one of the eigenvalues of the operator A. The matrix J is called 
the Jordan form of the operator A. 

Terms such as “an eigenvector of a matrix”, “an invariant subspace 
of a matrix”, etc. are used in the present chapter in the same sense 
attributed to them at the end of Sec. 5.0. For example, an eigen¬ 
vector of an n X n matrix is considered as an n-dimensional column 
vector, etc. 


6.1. Eigenvalues and Eigenvectors 

The present section includes problems, pertaining to the eigenvalues and 
eigenvectors of an operator, that can be solved without the use of the characteris¬ 
tic polynomial. These problems mostly concern the following topics: 

(i) Definition of eigenvalues and eigenvectors. 

(ii) A theorem about linear independence of eigenvectors associated with 
different eigenvalues, and corrollaries to it. 

(iii) Operators and matrices of simple structures. 

6.1.1. Prove that it is a necessary and sufficient condition for 
nondegeneracy of an operator A , that it should not have an eigen¬ 
value equal to zero.- 

6.1.2. Show that (a) the eigenvectors of an operator A associated 
with a zero eigenvalue, and no others, belong to the kernel of this 
operator; (b) the eigenvectors associated with nonzero eigenvalues 
belong to the image of the operator. 

6.1.3. Prove that if an operator A is nondegenerate, then both A 
and A ~ 1 have the same eigenvectors. Find the relation between the 
eigenvalues of these operators. 

6.1.4. Show that when an operator is multiplied by a nonzero 
number, the eigenvectors arc unaltered and the eigenvalues are 
also multiplied by this number. 

6.1.5. Show that the operator A — k 0 E has, for any number A 0 > 
the same eigenvectors as the operator A. Find the relation between 
the eigenvalues of these operators. 

6.1.6. Prove that if x is an eigenvector of an operator A, associated 
with an eigenvalue A., then x is also an eigenvector of the operator (a) 
A 2 ; (b) A h for any natural k\ and (c) / (A) where / ( t) is any polyno¬ 
mial. Find the corresponding eigenvalues. 
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6.1.7. Is the following statement valid: if x is an eigenvector of 
a certain polynomial / (A) in the operator A, then x is also an eigen¬ 
vector of the operator A itself? 

6.1.8. Prove that a nilpotent operator has no eigenvalues other 
than zero. 

6.1.9. Prove that the operator which rotates the Euclidean plane 
through an angle a, not a multiple of n has no eigenvectors. 

6.1.10. Find the eigenvalues and eigenvectors of the operator A 
of the three-dimensional Euclidean space such that Ax = [x, a], 
where a is a fixed vector. 

6.1.11. Find the eigenvalues and eigenvectors of the differential 
operator on the space of polynomials M„. 

6.1.12. Find the eigenvectors of the differential operator on the 
space generated by f t (J) = cos t, /, (t ) = sin t. 

6.1.13. Prove that the eigenvalues of a diagonal matrix coincide 
with its diagonal elements. 

6.1.14. Prove that a stochastic matrix has an eigenvalue equal 
to unity. Find the corresponding eigenvector. 

6.1.15*. Find the eigenvalues of a matrix A = xy having unit 
rank. 

6.1.16. Find the eigenvalues and eigenvectors of the n X n ma¬ 
trix J„ 

0*1 1 ... 1 


6.1.17. Find the eigenvalues and eigenvectors of the n X n 
matrix A: 

: b b ... I, II 


b b a 
bbb 


6.1.18. Prove that if the matrices A and B are similar, then every 
eigenvalue of A is also an eigenvalue of B, and vice versa. Find 
the relation between the eigenvectors of the matrices A and B. 

6.1.19*. Prove that an operator’s eigenvectors which are associated 
with different eigenvalues, are linearly independent. 

6.1.20. Using the result of Problem 6.1.19, deduce that an opera¬ 
tor A on an n-dimensional space X cannot have more than n dif¬ 
ferent eigenvalues. If there are precisely n different eigenvalues 
then a basis for the space X exists that consists of the eigenvectors 
of the operator A. 

6.1.21. Prove that the set of all eigenvectors of an operator A 
associated with a given eigenvalue X 0 . together with the zero vector 
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is a subspace called an eigensubspace of the operator A associated 
with the eigenvalue X 0 . 

6.1.22. A space X is the direct sum of snbspaces L l and L 2 . Find 
the eigenvalues and eigensubspaces of (a) the projection operator 
on Z.j parallel to L 2 ; (b) the reflection operator in L x parallel to L 2 . 

6.1.23. The dimension of the eigensubspace of an operator A 
associated with eigenvalue A, 0 is called the geometric multiplicity 
of the eigenvalue X 0 . Show that the geometric multiplicity of X 0 
is equal to the defect of the operator A — X 0 E. 

6.1.24. Prove that the sum of the eigensubspaces of an operator A 
is the direct sum. 

6.1.23. Prove that all nonzero vectors of a space are the eigenvec¬ 
tors of an operator A if and only if A is a scalar operator. 

6.1.26*. Prove that the sum of the geometric multiplicities of 
all the eigenvalues of an operator A from <o. YA does not exceed the 
dimension of the space X. Moreover, it is a necessary and sufficient 
condition that the indicated sum equal the dimension of the space X 
for a basis, made up of the eigenvectors of the operator A, to exist 
in the space X. 

6.1.27. An operator A is called an operator with a simple structure 
when there exists a basis for the space consisting of the eigenvectors 
of this operator. What is the geometric meaning of such an operator? 
What is the form of the matrix of the operator A with respect to the 
basis of eigenvectors? 

6.1.28. A square matrix is called a matrix of simple structure if 
it is similar to some diagonal matrix. Prove that an operator A 
from o) TA - is an operator of simple structure if and only if its matrix 
with respect to an arbitrary basis for the space is a matrix of simple 
structure. 

6.1.29. Prove that an operator of simple structure possesses the 
following properties: (a) the image is the span of the eigenvectors 
associated with the nonzero eigenvalues; (b) the intersection of 
the kernel and image consists of the zero vector only. 

6.1.30. Show that the projection and reflection operators are of 
simple structure. 

6.1.31. Prove that among nilpotent operators only the zero opera¬ 
tor is of simple structure. 

6.1.32. Prove that any polynomial / (A) in an operator of simple 
structure is also of simple structure. In particular, if A is nondege¬ 
nerate. then A _1 is of simple structure. 

6.1.33. Prove that if an operator A of an n-dimensional space is 
of simple structure, then the minimal polynomial of this operator 
has a degree not exceeding n. 

6.1.34. An operator A on an n-dimensional space X has n dif¬ 
ferent eigenvalues. Pro^ that any operator B that commutes with A 
is an operator of simple structure. 



156 


Linear Operator Structure 


Ch. 6 


6.1.35. Show that the operator B (see Problem 6.1.34) can be 
represented by a polynomial of the operator A. 

6.1.36. Let A be an operator on a real space R, and let A be 
the operator obtained from A by the complexification of the space R. 
Show that if x is an eigenvector of the operator A, associated with 
an eigenvalue X, then the vector x + iO is an eigenvector of the 
operator A associated with the same eigenvalue. 

6.1.37. Show that the operator A (see Problem 6.1.36) is of simple 
structure if A is an operator of simple structure. 

6.1.38. According to the definition of a matrix A of simple struc¬ 
ture, there exists a nondegenerate matrix P such that P~ l AP = A 
is a diagonal matrix. Prove that the diagonal elements of the mat¬ 
rix A are the eigenvalues, and the columns of the matrix P the 
eigenvectors of the matrix A. Conversely, a nondegenerate matrix P 
whose columns are the eigenvectors of a matrix A reduces this 
matrix to a diagonal matrix. 

6.1.39. Prove that if a matrix A is of simple structure, then the 
same is valid for the transpose of A, i.e. for A T . 

6.1.40. Let X be an eigenvalue and x the associated eigenvector of 
an m X m matrix A , and let p be an eigenvalue and y the associated 
eigenvector of an re X re matrix B. Prove that the Kronecker pro¬ 
duct x X y is: (a) an eigenvector of the matrix A X B; (b) an eigen¬ 
vector of the matrix A X E„ -f E m X B. Find the associated eigen¬ 
values. 

6.1.41. Prove that if the matrices A and B (see Problem 6.1.40) 
are of simple structure, then the same holds true for the matrices 
A X B and A X E n -f E„, X B. 

6.1.42. Deduce a corollary from Problem 6.1.41: if matrices A 
and B are of simple structure, then the operators G AB and F AB 
(see Problem 5.6.10) are of simple structure. 

6.1.43. Prove that if A is a matrix of simple structure, then so 
are all the associated matrices A p . 

6.2. The Characteristic Polynomial 

We intended in this section to illustrate the following topics related to the 
characteristic polynomial: 

(i) The definition of characteristic polynomial, the expression of its coef¬ 
ficients in terms of minors of the matrix, and the relation of the coefficients to 
the eigenvalues. 

(ii) The characteristic polynomial as a means of computing the eigen¬ 
values. 

(iii) The companion matrix of this polynomial. 

(iv) The characteristic polynomials of special classes of operators and 
matrices. 

As in the previous section, a great consideration is given to operators and 
matrices of simple structure. The lest, established in Problem 6.1.26, reveals 
its significance only here, i.e. when a method of computing the eigenvalues is 
available. 
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6.2.1. Write explicit expressions for the characteristic polyno¬ 
mials of matrices of order (a) 1; (b) 2; (c) 3. 

6.2.2*. Prove that in the expression of the characteristic polyno¬ 
mial | XE — A | of a matrix A in terms of powers of X 

| XE - A | = X» + a n _jX n-1 + . . . + ai \ + a 0 , 

the coefficient a h equals the sum of all principal minors of order 
n — k of the matrix A multiplied by (—1)”"'*. 

Set up the characteristic polynomials of the matrices 


6.2.3. x,y 2 • 

■ XiVn 6.2.4. 

0 

0 

.. 0 fc, 

|| *i!/i *>!/* ■ 

. x t ij„ 

0 

0 . 

.. 0 fc 2 

||*n!/i x„y t . 

•• x„y n 

0 

0 . 

.. o bn-i 


6.2.5. Prove that the characteristic polynomial of the transpose 
A T of a matrix A coincides with the characteristic polynomial of the 
matrix A. 

6.2.6. Prove that if each coefficient of a complex matrix A is 
replaced by its conjugate, then the coefficients of the characteristic 
polynomial are also replaced by their conjugates. 

6.2.7*. Given that A and B are square matrices of the same 
order, prove that the matrices AB and BA have the same charac¬ 
teristic polynomial. 

6.2.8. Prove that the characteristic polynomial / (X) of a matrix 
A and that g (X) of the matrix A — X 0 £ are related by the formula 

g(X)=/(X + X 0 ). 

6.2.9. Let an n X n matrix A be nondegenerate. Prove that 
the characteristic polynomial / (X) of the matrix A is related to the 
characteristic polynomial h (X) of the matrix A " l by the formula 

V'(v)- 

Hence deduce the relationship between the sums of all principal 
minors of a given order of the matrices A and A~ l . (Another method 
of stating this relationship is given in Problem 5.5.80.) 

6.2.10. Prove that similar matrices possess the same character¬ 
istic polynomial. Give an example demonstrating that the con¬ 
verse statement, viz., matrices having the same characteristic 
polynomial are similar, does not hold. 

6.2.11*. Prove that the following function in the elements of 
a matrix A 

m(A) = 
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is unaltered when Ihe similarity transformation is applied to the 
matrix. 

6.2.12. Assuming that the matrix A (see Problem (i.2.11) is 
complex, write an expression for the function m (A) in terms of 
the eigenvalues of this matrix. 

6.2.13. Generalizing the statement of Problem G.2.11, prove 
that the function 

m lC'4) = 2 2 2 •••2 a ihi a hi*t • • ■ Aft, .kAk.i 

!'=1 *1-1 *i=l k, 1 l-l I l 

is unaltered when the similarity transformation is applied to the 
matrix A. 

6.2.14. If re eigenvalues X„ . . ., X„ of a matrix A of order re + 1 
are given, how can another eigenvalue X„ +1 be found? 

6.2.15. Find the characteristic polynomial and eigenvalues 
of the triangular matrix 

0 a it ... a in 


0 0 

6.2.16. Prove that the characteristic polynomial of the matrix 

—a n -i — «n-* ••• — «i — <>o 

1 0 ... 0 0 

C(/(X)) = 0 1 ... 0 0 

0 0 ... 1 0 

is equal to / (X) = X" + Un-jX" -1 + . . . + OjX + a„. The matrix 
C (/ (X)) is called the companion of the polynomial f (X) (or the Fro- 
benius matrix). 

6.2.17. Use the result of Problem 6.2.16 to prove that any 
n-degree polynomial with the higher-order coefficient equal to 
unity can be the characteristic polynomial of a certain square /i-order 
matrix. 

6.2.18. Find the characteristic polynomial for the operator that 
rotates the Euclidean plane through an angle a. 

6.2.19. Find the characteristic polynomial for the operator A 
of the three-dimensional Euclidean space such that Ax = [x, a], 
where a is a fixed vector. 

6.2.20. Find the characteristic polynomial of the differential 
operator on the space M„. 

6.2.21. Find the characteristic polynomial of an arbitrary nil- 
potent operator on the re-dimensional complex space. 

6.2.22. Prove that the rank of a projection operator equals its 
trace. 
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6.2.23. Let an operator R reflect an n-dimensional space X in 
a subspace L. Prove that the dimension of L is related to the trace 
of the operator R by the following: 

tr if — 2 dim L — n. 

Evaluate the eigenvalues and eigenvectors of the following matri¬ 
ces: 


6.2.24. 


6.2.30. 


6.2.32. 


1 2 

0 | 


6 . 2 . 25 . I 

3 + i -1 

| 

lo 

2 | 


II 

2 i l-i 

1 * 

| 4 

_ 

1 _2 II 


4 1 HI 


2 


1 — 21 |. 

6.2 27 . | 

2 4 1 . 


|l 

— 

1 1 II 


0.1 4 || 


1 

2 

-5 -3 

6 . 2 . 29 . 1 

4 -4 


- 

1 

-2 -3 

• 

2 -2 


1 

3 

15 12 

1 

-4 4 

-2 

11 ° 

1 

0 01 | 

6 . 2 . 31 . 

10 10 


3 

0 

2 0 


110 1 


0 

2 

0 3 ' 


10 10 


|| 0 

0 

1 o|| 


0 111 


|| 

1 

2 () 

3 II 6 . 2 . 33 . 

3—10 

on 

-1 

— 2 0 - 

3 

0 3 0 

0 


0 

0 2 

0 * 

1 0 3 

1 

1 

1 

2 0 

3 II 

0 1 0 

3 II 


6.2.34. Prove tha't any operator of a real space of dimension 
n = 2k 4- 1 has at least one eigenvector. 

'Find the eigenvalues of the following matrices (a) in the field of 
real numbers; (b) in the field of complex numbers. 


6. 2 .35. || .|. 

6.2.37. Ill 0 2 ON 

0 10 2 

4 0 3 0 * 
II0 -1 0 31| 


“l: I 

6.2.38. Ill 1 0 Oil 

1 o -1 -2 
0 0 l 1 r 
111 2 1 o|| 


6.2.39. Show that the characteristic polynomial of a quasi-trian- 
gular (quasi-diagonal) matrix equals the product of the charac¬ 
teristic polynomials of the diagonal blocks. 

6.2.40. Using the results of Problems 6.2.8 and 6.2.9, show that 
the algebraic multiplicities of corresponding eigenvalues of the 
operators A and A — \ 0 E are equal; the same is true for the corres¬ 
ponding eigenvalues of the operators A and A -1 . 
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6.2.41*. Prove that the geometric multiplicity of any eigenval¬ 
ue X of an arbitrary operator A does not exceed its algebraic multi¬ 
plicity. 

6.2.42. Prove that an operator A on a complex space is of simple 
structure if and only if the geometric multiplicity of each eigen¬ 
value of this operator coincides with the algebraic multiplicity. 
Is the similar statement valid for a real space? 

Determine if each of the following matrices is of simple structure. 
If so, find a matrix that reduces the given one to diagonal form and 
give the diagonal matrix. 


6.2.43. 

0 0 0 1 

0 0 2 0 

6.2.44. 

0 0 0 0 
0 0 10 


0 3 0 0 
4 0 0 0 


0 2 0 0 
3 0 0 0 


6.2.45. 1 1 2 3 6.2.46. 1 1 2 3 

0 2 2 4 0 1 1 2 

001 — 2 * 0020 * 

1 0 0 2 0 0 0 2 


6.2.47. 

0 10 0 
0 0 1 0 

6.2.48. 

110 0 
3 0 10 


0 0 0 1 

— G 1 7 -1 


-10 0 1 

—2 0 0 0 


6.2.49*. Can the companion matrix of a polynomial / (X) be of 
simple structure if this polynomial has at least one multiple root? 

6.2.50. Prove that matrices A and B of simple structure are 
similar if and only if they have the same characteristic polynomial. 

6.2.51. Prove that a complex matrix with different eigenvalues 
is similar to the companion matrix of its characteristic polyno¬ 
mial. 

6.2.52. Find the characteristic polynomial of the n-order ma¬ 
trix P 

0 1 
0 1 

P = 

0 1 

1 0 

6.2.53*. Find the eigenvalues of the matrix P (see the previous 
problem) in the field of complex numbers, and the associated eigen¬ 
vectors. 

6.2.54. Using the result of Problem 6.2.53, show that any cir- 
culant over the field of complex numbers is a matrix of simple 
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structure. Find expressions for the eigenvalues of a circulant in 
terms of its elements. 

6.2.55*. Let A, lt . . ., \ m be all the different roots of a polyno¬ 
mial / (k). Find the eigenvectors of the companion matrix to this 
polynomial. 

6.2.56*. Deduce the result of Problem 6.2.53 from Problem 
6.2.55. 

6.2.57*. Let a matrix A be of simple structure. Prove that for 
any number k 0 , the rank of the matrix A — K 0 E is equal to the 
highest order of the nonzero principal minors in this matrix. 

6.2.58. Prove that any operator of simple structure is annihilated 
by its characteristic polynomial. 

6.2.59. Let A be an operator of simple structure on an re-dimen¬ 
sional space, and let . . ., X m be all the different eigenvalues 
of the operator A. Find the minimal polynomial of this operator. 

6.2.60*. Let A and B be rectangular matrices of orders m X re 
and re X m, respectively. Prove that the characteristic polynomials 
of the matrices AB and BA satisfy the equality: 

X n | XE m — AB | = k m I XE n - BA |. 

In particular, when m=n we obtain the result of Problem 6.2.7, 

6.2.61*. Prove that the characteristic polynomial of the ma¬ 
trix M 



where A and B are square matrices of the same order, equals the 
product of the characteristic polynomials of the matrices A + B 
and A — B. 

6.2.62. Prove that on complexifying the real linear space, an 
operator A is transformed into the operator A with the same char¬ 
acteristic polynomial. 

6.2.63. Show that the result of Problem 6.2.21 also holds for 
a nilpotent operator on the n-dimensional real space. 

6.2.64. Prove that the characteristic polynomial of a real 2n-order 
matrix D 



equals the product of the characteristic polynomials of re X re com¬ 
plex matrices A = B + iC and A = B — iC. 

6.3. Invariant Subspaces 

The first half of this section is devoted to problems in invariant subspacos and 
induced operators. In the second half, we consider a theorem and its corollaries 
concerning the possibility of reducing the matrix of an operator to triangular 
form. 


ii-oflie 






6.3.1. Prove that the sum and intersection of 4-invariant sub¬ 
spaces L x and Z, 2 are also invariant with respect to the operator 4. 

6.3.2. Show that the kernel and image of an operator A from 
®. T . T are .4-invariant. 

6.3.3. Prove that if an operator A is degenerate, then any sub¬ 
space containing its image is 4-invariant. 

6.3.4. State the geometric meaning of the one-dimensional inva¬ 
riant subspaces of an operator and show that in a complex space 
any operator has at least one one-dimensional invariant subspace. 

6.3.5. What can be said about an operator A from such 
that any subspace of the space X is 4-invariant? 

6.3.6*. Prove that if any subspace of dimension k (where k is 
a fixed natural number, 1 k < n) of an n-dimensional space X 
is 4-invariant, then A is a scalar operator. 

6.3.7. Prove that the span of any set of the eigenvectors of an 
operator A is 4-invariant. In particular, eigensubspaces of the 
operator A are 4-invariant. 

6.3.8. Prove that operators A and A — kE, where k is any num¬ 
ber, possess the same invariant subspaces. 

6.3.9*. Show that any operator on an n-dimensional complex 
space has an invariant subspace of dimension n — 1. 

6.3.10. Prove that if an operator A is nondegenerate, then both 
A and A -1 possess the same invariant subspaces. 

6.3.11. Show that any 4-invariant subspace is also invariant 
with respect to any polynomial of this operator. Is the converse 
statement true? 

6.3.12. Prove that both the kernel and image of any polynomial 
j (A) in an operator A are 4-invariant. 

6.3.13. Let operators A and B commute. Prove that Jhe kernel 
and image of the operator B are 4-invariant. 

6.3.14. Prove that any eigensubspace of an operator A is inva¬ 
riant with respect to any operator commuting with A. 

6.3.15. Prove that if an operator A on an n-dimensional space 
has n different eigenvalues, then any operators, commuting with A, 
is of simple structure. Further, all the eigenvectors of the opera¬ 
tor A are also eigenvectors of the operator B. 

6.3.16. Find all 4-invariant subspaces of the three-dimensional 
Euclidean space, where Ax = [x, a] and a is a fixed vector. Deter¬ 
mine the induced operator AIL for each invariant subspace L. 

6.3.17*. Find all invariant subspaces of the differential opera¬ 
tor on the space of polynomials M„. 

6.3.18. A space X of dimension n is the direct sum of a subspace 
L x of dimension k (> 0) and subspace L 2 of dimension n — k. Sup¬ 
pose a basis e lt . . ., e n for the space is selected so that the vectors 
Cj, . . ., e k belong to L lt and the vectors . . ., e n to the sub¬ 
space L 2 . Represent the matrix of an operator 4 with respect to 



6.3 


Invariant Subspaces 


the basis e lt . . ., e„ in partitioned form 



where A n and A 22 are square submatrices of orders k and n — k, 
respectively. Prove that (a) A 2J = 0 if and only if L 2 is ^-invariant; 
(b) A 21 = 0 and A 12 = 0 if and only if both the subspaces L 2 and 
L 2 are ^-invariant. 

6.3.19. Show that any complex n-order square matrix A is similar 
to a matrix B of the form 



where B 22 is a submatrix of order n — 1. Give a method of construct¬ 
ing a transforming matrix P such that B = P^AP. 

6.3.20. If an operator A is on a complex space, then prove that 
any .4-invariant subspace contains at least one eigenvector of this 
operator. 

6.3.21. Let L be an .4-invariant subspace. Prove that (a) the 
characteristic polynomial of the induced operator AIL is a divisor 
of the characteristic polynomial of the operator A \ (b) the minimal 
polynomial of the induced operator AIL is a divisor of the minimal 
polynomial of the operator A. 

6.3.22. Subspaces L 2 and L 2 are invariant with respect to an 
operator A with L 2 cr L 2 . Prove that the characteristic polyno¬ 
mial of the operator AIL X is a divisor of the characteristic polyno¬ 
mial of the operator A/L 2 . A similar statement is valid for the 
minimal polynomials. 

6.3.23. Subspaces L x and L 2 are invariant with respect to an 
operator A. Prove that the characteristic polynomial of the opera¬ 
tor AI(L 2 + L 2 ) is a common multiple of, and that of the operator 
A/(L 1 f) L 2 ) is a common divisor of, the characteristic polynomials 
of the operators A/L 2 and A/L 2 . A similar statement holds for the 
minimal polynomials. 

6.3.24*. Prove that an operator A of simple structure induces 
an operator of simple structure AIL on each of its invariant sub¬ 
spaces L. 

6.3.25. Deduce the following corollary to Problem 6.3.24: any 
nontrivial invariant subspace of an operator A of simple structure 
is spanned on a certain set of the eigenvectors of this operator. 

6.3.26. Prove that for commuting operators of simple structure 
A and B, there exists a basis for the space consisting of the common 
eigenvectors of these operators. 

6.3.27. Prove that any two commuting operators on a complex 
space have a common eigenvector. 

u* 
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6.3.28. Prove that for any (even infinite) set G consisting of 
mutually commuting operators on a complex space, there is a com¬ 
mon eigenvector for all the operators from G. 

6.3.29. An operator A is reducible by two subspaces L x and L 2 . 
Prove that (a) the rank of the operator A is equal to the sum of the 
ranks of the operators AIL Y and A/L 2 ; (b) the characteristic polyno¬ 
mial of the operator A equals the product of the characteristic poly¬ 
nomials of the operators AIL j and AIL 2 \ (c) the minimal polynomial 
A is the least common multiple of the minimal polynomials AIL l 
and A/L 2 ; (d) the operator A h is, for any whole number, the direct 
sum of the operators (A/L l ) h and ( A/L 2 ) h ; (e) for any polynomial 
/ (t), the operator f (A) is the direct sum of the operators f (A/LJ 
and / (A/L 2 ). 

6.3.30. Prove that the differential operator on the space M„ 
cannot be reduced by any pair of subspaces. 

6.3.31. Let R be a real linear space and let C be a complex space 
obtained from R by complexification. Let L be a subspace of R 
which is invariant with respect to an operator A, and let e lt . . ., e k 
be a basis for L. Show that the span of the vectors e x + iO, ... 

. . ., e k + t'O of the space C is .4-invariant, A being the operator 
corresponding to A. 

6.3.32*. Using complexification, prove that any operator on a 
real linear space has an invariant subspace of dimension 1 or 2. 

6.3.33. Find a two-dimensional invariant snbspace of the matrix 



considered as an operator of the real arithmetic space R 3 . 

6.3.34. Let re-dimensional column vectors z v . . ., z h , z } = 
= xj + iyj form a basis for a /c-dimensional subspace of the complex 
matrix A = B -f- iC. Prove that the 2re-dimensional real column 
vectors u lt . . ., u*, v lt .... u* where 



form a basis for a 2/c-dimensional invariant subspace of the real 
matrix 



6.3.35. Vectors e lf . . ., e h form a basis for a ^-dimensional inva¬ 
riant subspace of an m X m matrix A and vectors / 1( . . ., f t form 
a basis for an f-dimensional invariant subspace of an re X re matrix B. 
Prove that in the following matrices the span of the Kronecker pro¬ 
ducts e t x f } , i = l,.. ., h, j = 1, . . ., I, is a ^1-dimensional 
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invariant subspace: (a) of the matrix A x B; (b) of the matrix 
A x E n + E m x B. 

6.3.36*. Prove that for any operator A on an n-dimensional 
complex space X, there is a sequence of invariant subspaces L u 
L 2 , . . ., L „.„ L n such that the dimension of the subspace L h 
equals k and 

LjC= L 2 a . . .c— L n . 2 d L n = X. 

Show that the matrix of the operator A, with respect to a basis for 
the space having e t £ L lt is upper triangular. However, if the order 
of the basis vectors is reversed to e n , . . ., e„ then the matrix of 
the operator assumes lower triangular form. State the meaning of 
the diagonal elements of these matrices. 

6.3.37. Deduce the following corollary to Problem 6.3.36: any 
complex square matrix is similar to an upper (lower) triangular 
matrix. 

6.3.38*. Prove the statement of the previous problem without 
using the result of Problem 6.3.36. 

6.3.39. Prove that triangular form of a given complex matrix A 
is not unique, viz., each order of the eigenvalues . . ., of the 
matrix A has a corresponding upper (lower) triangular matrix similar 
to A in which the elements X,, . . ., X n on the principal diagonal 
are arranged in the required order. 

Reduce the following matrices to triangular form by a similarity 
transformation (indicate the obtained triangular forms and the 
transforming matrices): 

6.3.40. II l 0 in 6.3.41. II 5 2 11| 

II 0 1 o|| || 7 4 31| 

6.3.42*. Let X lt . . ., X m be all the different eigenvalues for 
a complex n X n matrix A, and k 2 , . . ., k m the algebraic multi¬ 
plicities of these eigenvalues. Prove that the matrix A is of simple 
structure if and only if it is similar to a matrix B of the following 
block structure 



KE ht 

B 13 . 

.. B ,m 


0 

*■2 E h, • 

B 2m 

B = 

0 

0 X,E hi . 

B 2 m 


0 

0 0 

ki n E k m 


6.3.43. Prove that an operator on a complex space is nilpotent 
if and only if all its eigenvalues are equal to zero. 

6.3.44*. Prove that the community matrices A and B can be 
reduced to triangular form by the same similarity transformation. 
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6.3.45. What does the statement of Problem 6.3.44 mean for the 
commuting operators A and Bf 

6.3.46*. Prove that any real square matrix is similar to an up¬ 
per (lower) quasitriangular matrix whose diagonal blocks are of 
order 1 or 2. 

6.3.47. Deduce the following corollary to the result of Prob¬ 
lem 6.3.46, viz., that any operator on an n-dimensional space has 
an invariant subspace of dimension n —1 or n — 2. 

6.3.48*. X lt . . ., X m are the eigenvalues of a complex m X m 
matrix A, and p lt .... the eigenvalues of a complex n X n 
matrix B (each sequence may contain equal terms). Prove that (a) 
the mn products X^;, i = 1 , . . ., to , / = 1 , . . ., n represent 
collectively all the eigenvalues of the matrix A X B and the op¬ 
erator G ab (see Problem 5.6.10); (b) the mn sums X, + p.y, i = 
= 1, . . ., m, 7 = 1, . . ., n represent collectively all the eigen¬ 
values of the matrix A X E„ 4- E m X B and operator F AB . 

6.3.49. Prove that the matrix equation 

AX -f XB = C 

(where A , B and C are given complex matrices of orders m X m, 
n X n and m X n, respectively) has a unique solution if there are 
no eigenvalues X <t of the matrix A, and of the matrix B, such 
that X* -r py = 0. 

6.3.50*. An operator A on a complex space is reducible by two 
subspaces L x and L z , and the induced operators AIL X and AIL 2 have 
no equal eigenvalues. Prove that any operator B that commutes 
with A is reducible by the same two subspaces L x and L 2 . Extend 
this statement to the case of any finite number of subspaces. 

6.3.51. Let X lt . . ., X„ be the eigenvalues of a complex n X n 
matrix A (some of the numbers X, may be equal). Prove that all 
the possible products of p numbers from X,, . . ., X n represent all 
the eigenvalues of the p-th associated matrix A p . 


6.4. Root Subspaces 
and the Jordan Form 

The problems in this section are grouped in the following sequence: 

Root subspaces. The basic tools here are: a theorem on the decomposition of 
a complex space into the direct sum of the root subspaces of an operator A, 
and the characterization of the root subspace K > t that corresponds to an eigen¬ 
value as the kernel of some power of the operator A — }. t E. Corollaries to this 
theorem as well as computational problems on the construction of root subspaces 
are given and the concept of the height of a root vector is discussed. 

The structure of a root subspace. The material is expounded by degrees, begin¬ 
ning with the simplest case, i.e. when the maximum height of a root vector 
coincides with the dimension of the root subspace. The situation then is gra¬ 
dually becoming more complex until the most general case is considered. At 
each stage we illustrate the structure of a canonical basis, and provide some 
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computational examples. Having got an insight into the structure of an indi¬ 
vidual root subspace, we proceed to 

The construction of the Jordan form of an arbitrary operator. In addition to 
computational problems, we also offer here a number of theoretical problems 
about the use of the Jordan form. In particular, the formulae which enable the 
Jordan form to be computed without resorting to the construction of a canonical 
basis are derived. The section is concluded Dy problems on 

The relation between the similarity of matrices and the Jordan form. 

Throughout this section we will consider only operators on a complex space 
and complex matrices unless otherwise stated. 

6.4.1. Using Problems 5.3.9 and 5.3.10, prove that for any op¬ 
erator A on an n-diraensional, real or complex, space X , the space X 
can be decomposed into the direct sum of subspaces 

X = N+T, (6.4.1) 

where N is the kernel, and T the image of the operator A q for some 
natural number q. Moreover, for the least possible q , this inequality 
is valid: n. 

Show that the operator A induces a nilpotent operator on the 
subspace N, and a nondegenerate operator on the subspace T. Thus, 
the statement of the problem may be reformulated as follows: any 
operator A is the direct sum of a nilpotent and a nondegenerate 
operator. 

6.4.2*. Prove that the decomposition of an operator A into the 
direct sura of nilpotent and nondegenerate operators is unique. 

6.4.3. Prove that the dimension of a subspace N in the decom¬ 
position (6.4.1) equals the algebraic multiplicity of the zero eigen¬ 
value of an operator A. 

6.4.4*. Prove that for any operator A, a space X can be decom¬ 
posed into the direct sum of subspaces K). x , . . ., K), m 


X = K K + K K +...+K>. m (6.4.2) 

(where X v .... are all the different eigenvalues of the operator A 
having algebraic multiplicities k v . . ., k m , respectively) such 
that each of the subspaces K) w[ is ^-invariant, and the induced opera¬ 
tor AIK% i has the characteristic polynomial (X — Xj) h< . 

6.4.5. Prove that the decomposition in (6.4.2) is unique if the 
operator A satisfies the conditions listed in Problem 6.4.4. 

6.4.6. A subspace in the decomposition (6.4.2) is called a 

root subspace associated with an eigenvalue Show that it follows 
from Problems 6.4.1-6.4.5 that (a) the subspace K\ [ can be described 
as a set of all vectors x such that (A — E)‘x = 0, where s is any 
natural number; (b) the subspace can be described as the kernel 
of the operator (A — where q t is a certain natural number 
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not exceeding ft,; (c) the eigensubspace L ^ associated with an eigen¬ 
value X,, is contained in the root subspace 

6.4.7. Show that for an operator A to be of simple structure it is 
necessary and sufficient that each eigensubspace L * of this operator 
associated with the eigenvalue X, should coincide with the root sub¬ 
space K\ t . 

6.4.8. Prove that if K\ is a root subspace of an operator A asso¬ 
ciated with an eigenvalue X,, then (a) K% is the root subspace of the 
operator A — X 0 £ associated with the eigenvalue X, — X 0 ; (b) 

is the root subspace of the operator A _1 associated with the eigen¬ 
value 1/Xj. 

6.4.9*. Prove that any root subspace of an operator A is inva¬ 
riant with respect to any operator B which commutes with A. 

6.4.10*. Prove the Cayley-Hamilton theorem , viz., that any 
operator A is annihilated by its characteristic polynomial. 

6.4.11. Prove that if an operator A of an re-dimensional space is 
nondegenerate, then the inverse operator A~ x can be represented 
as a polynomial of degree re — 1 in A. 

Construct the root subspaces of the following matrices: 


6.4.12. 

-1 1 ill 
— 3 2 2 . 

-1 1 ill 

6.4.13. 

-HJI 

6.4.14. 

2 3 0 3 

-10 12 

6.4.15. 

2-34-6 

1-2 2-4 


0 3 2 3 

12-10 


0 0 2 -3 

0 0 1-2 


6.4.16. Any vector of a root [subspace K\ of an operator A is 
called a root vector of this operator associated with the eigenvalue X,. 
A natural number h such that (A — X t E) h x = 0, but (A — k i E) h ~ 1 
x^O is called the height of a root vector x from K\ f . By definition, 
the height of the null vector is zero. 

Show that (a) the height of each vector from K\ t does not exceed 
the algebraic multiplicity ft, of the eigenvalue X,; (b) the height 
of an eigenvector equals 1; (c) the set H h of all vectors from K\i 
whose height does not exceed a given natural k is a subspace. 

6.4.17*. Let z be a root vector of an operator A associated with 
an eigenvalue X, and with a height h (> 0). Prove that (a) the vector 
(A — X t E) x has the height ft—1; (b) the vector (A — kjE) x, where 
X^ is an eigenvalue of the operator A other than X,, has the height 
ft; (c) if X, is a root of a polynomial / (t) with a multiplicity of l, 
where l^h, then the vector f(A)x has height ft — /; (d) the vector 
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A~ x x has height h; (e) if B is an operator that commutes with A, 
then the height of the vector Bx does not exceed h. 

6.4.18. Show that a root vector x of an operator A is also a root 
vector with the same height of (a) the operator A — X 0 E; (b) the 
operator A -1 . 

6.4.19. Prove that a set of nonzero vectors from K\ t , all of whose 
heights are different, is linearly independent. 

6.4.20. Let x be a vector from K\ t with a height h. 

Show that (a) the vector set (A — ‘k l E) h ~ l x, (A— ‘k i E) h ~ i x , . . . 
. . ., (A — X t E) x , x is linearly independent; (b) the span of the set 
is ^-invariant. 

In Problems 6.4.21-6.4.62 the only operators of an ra-dimensional 
space and matrices of order n that will be considered are those which 
have only one eigenvalue A 0 with an algebraic multiplicity n. This 
condition will not be made explicit henceforward. It should be clear 
that all the results obtained will also be valid for an arbitrary oper¬ 
ator that is considered only on a root subspace. 

6.4.21. An operator A on an n-dimensional space X is said to be 
a one-block operator if the maximum possible height of the root 
vector coincides with the dimension n of the space. Prove that (a) 
any basis for the space X contains at least one vector of height n; 

(b) if x is a vector of height n, then the vector set (A — A. 0 £) n_1 x, 
(A — X 0 E) n ~ 2 x, .... (A — X 0 E) x, x is a basis for the space X; 

(c) the matrix of the operator A with respect to this basis is a Jordan 
block of order n corresponding to the number A. 0 . The last statement 
accounts for the term “one-block operator”. 

Thus, in the case of a one-block operator the canonical basis is the 
set (A — A, 0 £) n_1 ;r, . . ., (A — X 0 E) x, x called the series constructed 
from the vector x , and the Jordan form consists of one block of or¬ 
der n. 

6.4.22. Find the matrix of the operator A (see Problem 6.4.21, (b)) 
with respect to the basis x {A — X 0 E) x, (A — X 0 E) n ~ 1 x. 

Construct the canonical basis and find the Jordan form of the 
following matrices: 


6.4.23. | 

1 11 4 II 

|-4 31|* 

6.4.24. 

II 5 ~ 9 _4 ll 

6 -11 — 5 . 
||-7 13 61| 

6.4.25. 

3 i 0 0 

0 2 10 

6.4.26. 

5 _10 10 -5 1 

1 0 0 0 0 


0 0 2 1 

-1 -1 -1 1 


0 10 0 0 

0 0 10 0 

0 0 0 1 0 
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Find the Jordan form of the following matrices of order n: 
6.4.27. 


1 a 0 0 ... 0 0 

0 1 a 0 ... 0 0 

0 0 1 a ... 0 0 


0 0 0 0 .. 
0 0 0 0 . 
9 a x 0 0 
0 9 a, 0 
0 0 


a^0. 


a, . 


0 0 
0 0 
0 0 


0 0 0 0 ... 9 an-! 

0 0 0 0 ... 0 9 

a,a, ... a„_i ^= 0. 
1 2 3 4...* 

0123...H- 
0 0 1 2 ... n- 


0 0 0 0 ... 1 
a a is a„ ... a 

0 a a 23 ... a 

0 0 a ... a 


2 3 4 5 ... n + 1 
0234 ... n 
0 0 2 3... *-l 


0 0 0 0 ... 


a 12 a u ... a„_,, „ =^,0. 


6.4.33. Find the canonical basis and Jordan form of the differen¬ 
tial operator on the space of polynomials M. 

6.4.34. Prove that if A is a one-block operator associated with 
an eigenvalue X 0 0, then (a) the operator A 2 ; (b) the operator A 1 
where l is any natural number; (c) the operator A' 1 , are also one- 
block. 

6.4.35. Show that if A is a one-block operator associated with the 
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zero eigenvalue, then A 2 is not a one-block operator (the dimension 
of the space is assumed to be greater than 1). 

6.4.36. Given a one-block operator A, prove that the subspace 
H h , which is the kernel of the operator (A — A, 0 E)\ has the dimen¬ 
sion k, 0 <. k^. n. 

6.4.37. Prove that a one-block operator A has no nontrivial 
invariant subspaces that are different from the subspaces H h (see 
Problem 6.4.36). 

6.4.38. Let A and B be commutative one-block operators. Prove 
that .4-invariant and fl-invariant subspaces coincide. 

6.4.39. Prove that the minimal polynomial of a one-block opera¬ 
tor A coincides with its characteristic polynomial. 

6.4.40*. Let the maximum height of a vector in a space X be 
equal to t. Given that the vectors x x , . . x p are linearly inde¬ 
pendent and have a height t, and that the intersection of the span 
of the vectors x x , . . x p and the subspace H consists of the 
null vector only, prove that for any natural k, 0 <.k <.t, the vectors 
(A — \ Q E) h x lt . . ., (A — X 0 E) h x p are linearly independent, and 
that the intersection of the span of these vectors and the subspace 
H t . k . x consists of the null vector only (remember that the subspace 
H t . h . x is the kernel of the operator (A — X 0 E) h ). 

6.4.41. Denote the defect of the operator (A — k 0 E) h by m h . 
Deduce the following inequalities from the result of Problem 6.4.40: 
n — m t . l = m t — m h — m k . lt where 0 < k < t, m 0 — 0. 

6.4.42*. Prove that the series, constructed in Problem 6.4.40 
on the vectors x x , . . ., x p , form a linearly independent set. 

6.4.43. Show that if, in addition to the data of Problem 6.4.40, 
the relation n = (n — m t . x ) t (where n is the dimension of the 
space X) is valid, then (a) the series (.4 — . . ., 

. . ., (A — k. 0 E) x lt x v . . ., {A — X 0 £) ,-i £ p, .... (A — k 0 E) x p , x p 
form a basis for the space X (we put p = n — m, _x); (b) the matrix 
of the operator A with respect to this basis is of the following quasi¬ 
diagonal form 

If A 0 

10 Jp 

where each of the matrices J v / 2 , . . ., J p is a Jordan block of 
order t, corresponding to the number k 0 . 

Thus, in the above case, the canonical basis for the operator A 
consists of a number of series that have the maximum possible 
length, and the Jordan form consists of a number of Jordan blocks 
of the same order. 
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Construct the canonical basis, and find the Jordan form of the 
following matrices: 


6.4.44. 1 1-2 0 

6.4.45. 99 

0 

0 

101 

2 10 2 

0 

99 

0 

0 

10 11 

0 

101 

99 

0 

0—1 2 1 

0 

0 

0 

99 


-3 

1 

0 

0 

0 

0 

6.4.47. 

2 

0 

0 

0 

0 

0 

-3 

0 

1 

0 

0 

0 


0 

2 

0 

0 

0 

0 

—1 

0 

0 

0 

0 

0 


0 

0 

2 

0 

0 

0 

0 

0 

0 

0 

0 

—1 


0 

-3 

0 

2 

0 

0 

0 

0 

0 

1 

0 

—3 


—1 

0 

0 

0 

2 

0 

0 

0 

0 

0 

1 

-3 


0 

0 

-5 

0 

0 

2 


6.4.48. Find the canonical basis and Jordan form of the double 
differentiation operator on the space of polynomials M n , assuming 
that n = 2k — 1, where A: is a whole number. 

6.4.49. The maximum height of a vector in a space X equals t. 
Linearly independent vectors x lt . . ., x p all have heights, and the 
space X is the direct sum of the subspace /fj.j and the span drawn 
on this vector set. Prove that if the following inequality holds for 
the numbers m h (see Problem 6.4.41), 


nii — m t _j < mt-i — m |_ 2 , 


then (a) the series constructed on the vectors x x , . . ., x p do not 
form a basis for the space X; (b) the series constructed on the vectors 
(A—X 0 E) Xj, . . ., (A— X 0 E) x Pl do not form a basis for the subspace 
H |_ X ; (c) if linearly independent vectors x Pl+1 , . . ., x p , having height 
t — 1 are such that the direct sum of the span, drawn on the vector 
set (A — A, 0 £) x lt . . ., (A — X 0 E)x Pl , x Pl+1 , . . ., x Pt and the 
subspace H t . 2 , is the subspace H t . x , then the series constructed on 
the vectors x x , . . ., x Pl , x Pl+1 , . . ., x p form a linearly indepen¬ 
dent set; (d) the numbers m h satisfy the relations 

m t-i — m t-2^ m k — m h . i. 


where 0 < k < t — 1, m 0 = 0. 

6.4.50. Find a relationship connecting the dimension n of the 
space X, the maximum height t of the vectors and the numbers m h , 
which will imply that the series, constructed in Problem 6.4.49 (c), 
form a basis for X. Construct the Jordan form of the operator .4 for 
this case. 
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Construct the canonical basis and find the Jordan form of the 
following matrices: 

6.4.51. II 4 l ill 6.4.52. II5 1 -1 -111 

— 2 1 —:2 . 15—1 -1 

|| 1 1 41 | 11 3 —1 ' 

111 1 -1 31 | 

6.4.53. —2 0 3 4 5 

0 —2 0 6 7 

0 0 —2 0 8 

0 0 0 —2 0 

0 0 0 0 —2 

6.4.54. 1-1 0-1 0 

2—2 0—1 0 

1_1_1 o 0 

2-1 0-2 0 

2-1 0-1 -1 

6.4.55. Find the canonical basis and Jordan form of the double 
differentiation operator on the space of polynomials M„, assuming 
that n = 2k, where A: is a whole number. 

6.4.56. Show that generally a basis for a space can be made up 
of p x series with a maximum length t, p z — pi series of length t — 1, 
and for any 0 < k < t, Pt-h+i — Pi-k series of length k. Here 

Pk — m t -Jt+l — 

Find the Jordan form of the operator for this case. 

6.4.57. Deduce the following corollary to the result of Prob¬ 
lem 6.4.56: the numbers m h satisfy the inequalities 

m r+ i — m r ^. m, +1 — m, 

if r > s. 

6.4.58. Could there be a nilpotent operator A on an 8-dimension¬ 
al space such that the ranks r h of the operators A * form the se¬ 
quence 6, 4, 3, 1, 0? 

Construct the canonical basis, and find the Jordan form of the 
following matrices: 


6.4.59. 

1110 

-13 0 1 

6 . 4 . 60 . 

—3 1 -3 -2 -2 

0—2100 


—1 0-11 

0 - 1-11 


10 0 11 

10 10 1 

10 110 


-1 1 
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6.4.61. 


6.4.62*. 


3 6 

0 0 

—1 —2 

0 0 

0 0 

0 0 

2 0 1 
0 2 0 
0 0 1 
0 0 0 
2 0 1 
0 0 0 



Using the procedure for constructing a canonical basis for a root 
subspace, described in the previous section, and also the decompo¬ 
sition of the space into a direct sum of root subspaces, find the cano¬ 
nical basis and the Jordan form of the following matrices: - 


6.4.63. 

-2-1 11 

6.4.64. II 3 

-1 in 


5 -1 4. 

2 

4 - 2 • 


5 1 2 1 

1 -2 

2 oil 

6.4.65. 

—4 4 2II 

6.4.66. | • 

0 -111 


—5 4 3 I 

h 

-1 -ill' 

6.4.67. 

0 0-53 

6 . 4 . 68 . 

-3 4 3 15 


0 0-31 


-110 5 


-5 3 0 0 


0 0-3-3 


i— 3 1 0 0 


0 0 2 2 


6.4.69. 

-2 4 0 0 

—12 0 0 

6.4.70. 

4 111 

—1 2 —1 —1 


—2 4—1 0 

3-6 0—1 


6 1-11 

-6—1 4 2 


6.4.71. The vectors of the canonical basis for an operator A have 
been numerated in reverse order. How is the matrix of the opera¬ 
tor altered? 

6.4.72. Given the Jordan form of an operator A, find the Jordan 
form of the operator (a) A — X 0 E; (b) A ~ l . 

6.4.73. Show that if . . ., h n are the eigenvalues (some of 
which may be equal) of an operator A of an n-dimensional space, 
then the numbers f (hi), . . ., f (K) are the eigenvalues of the 
polynomial / (.4). 
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6.4.74. Prove that any operator on a complex space is the direct 
sum of one-block operators. 

6.4.75*. Given the Jordan form of an operator .<4, find the Jordan 
form of the operator A 2 . 

6.4.76. Prove that any operator on a complex space can be re¬ 
presented as the sum of an operator of simple structure and a nil- 
potent operator. 

6.4.77*. Prove that a non-scalar operator A, fulfilling the con¬ 
dition A 2 = E, is a reflection operator. 

6.4.78. Prove that an operator A, fulfilling the condition A h = E 
for a certain natural number k, is of simple structure. 

6.4.79*. Prove that in any Jordan form of an operator A, the num¬ 
ber of the Jordan blocks, corresponding to an eigenvalue A 0 , equals 
the defect m 1 of the operator A — \ 0 E. 

6.4.80*. Prove that in any Jordan form of an operator A, the 
number of the Jordan blocks, corresponding to an eigenvalue A* 
and having an order greater than or equl to k, is determined by 
the formula 

= m h — nik-!, 


where m 0 = 0, and m k is the defect of the operator (A — A 0 £) ft . 
6.4.81. Deduce from the result of Problem 6.4.80 that 


S h = 2 m h — m h+1 — m/t-i, 


where S h is the number of the Jordan blocks corresponding to the 
eigenvalue A 0 and having the order k. 

Thus, the Jordan form of any operator is uniquely determined 
by the position of the Jordan blocks on the diagonal. 

Without computing the canonical basis, find the Jordan form 
of the following matrices: 


—20100 
—20010 
3 0 0 0 1 
—10000 


5 0 6 7 9 14 


0 5 0 8 10 15 
0 0 5 0 11 16 
0 0 0 5 12 17 
0 0 0 0 13 18 
0 0 0 0 0 19 


0 1 0 0 0 

0 0 10 0 
0 0 0 1 0 

0 0 0 0 1 

1 - 1-221 
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6.4.85. 2 0 0 0 0 0 
0 2 0 0 0 0 

1_1_4 0 0 0 

3 2 1 —4 0 0- 

—2 2 5 7 —4 0 

4 3 8 6 0 —4 

6 . 4 . 86 *. 0 0 1 1 0 0 

10-301 0 

0 1 3 0 0 1 

0 0 0 0 0 1 * 

00 010-3 

0 0 0 0 1 3 

6.4.87*. 0 0 1 -1 0 1 

10—31—1—3 ^ 

0 13 0 12 

0 0 0 0 0 1 * 

0 0 0 1 0 -3 

0 0 0 0 1 3 

6.4.88. Find the Jordan form of the difference operator A x on 
the space of polynomials M„. 

6.4.89. Find the Jordan form of (a) the triple differentiation oper¬ 
ator; (b) the operator A 3 ., where A t is a difference operator, on the 
space of polynomials M s . 

6.4.90. Show that in each class of similar matrices there is a uni¬ 
que Jordan form for each positioning of the diagonal Jordan blocks. 

Determine whether the following matrices A, B and C are simi¬ 
lar: 

6.4.91. II —3 2 5 || || 59 -63 521| 

A* = —12 8 20 , 5 = | —147 159 -132 , 

|| 3 —2 -5 || || -244 263 -2191| 

|| 59 -63 521| 

C = -147 159 —132 

|l —244 263 —2181| 

6.4.92. | 3 1 -1 1| || 5 5 -2 || 

A = \ -3 -1 3 , 5= -2 -1 1 II, 

I -2 -2 41| || -1 -1 2 || 

5= 3 2 6 I 

II -2 0 -2 | 
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6.4.93. II-1 -1 21| 

.4 = 11 3 -5 6 

II 2 -2 21| 

|| 0 6 61 | 

C = 1-2 16 12 I 

|| 4 —28 —201| 

6.4.94. Prove that any complex matrix A is similar to its trans¬ 
pose A T . 

6.4.95. What can be said about the Jordan form of a matrix A 
similar to its inverse A -1 ? 

6.4.96. Prove that a Jordan block is similar to the companion 
matrix of its characteristic polynomial, i.e., to the Frobenius ma¬ 
trix. 

6.4.97. Prove that any complex matrix is similar to a quasi-dia¬ 
gonal matrix all of whose diagonal blocks are the Frobenius matri¬ 
ces. 

6.4.98*. Find the necessary and sufficient condition for the mini¬ 
mal polynomial of a complex matrix to coincide with its charac¬ 
teristic polynomial. 

6.4.99. Let A.„ . . ., \ m be eigenvalues, all different, of an 
n X n complex matrix A . Prove that the matrix A is of simple struc¬ 
ture if and only if the polynomial (k — k 1 )...(X — \ m ) is the 
minimal polynomial of A. 

6.4.100*. Given an m-order matrix A of simple structure and 
the Jordan form / of an n X n matrix B. Find the Jordan form 
of the matrix (a) A X B\ (b) A X E n + E m X B. 

Apply the derived results to the operators G AB and ^ Afl (see 
Problem 5.6.10). 

6.4.101. Find the Jordan form of the n-order matrix 


—8 12 -C 
—10 18 —10 
-12 24 —14 


where e is positive and positioned in (n, 1), and the off-diagonal 
elements which are not indicated are zeroes. 

6.4.102*. Replace the unit off-diagonal elements, if any, of the 
Jordan form of a matrix A by an arbitrary number e^0. Prove 
that the matrix obtained is similar to the matrix A. 


12-0619 



CHAPTER 7 


Unitary Space Operators 


7.0. Terminology and General Notes 

Assume that X and Y are two spaces that are either both Euclidean 
or both unitary, and consider a linear operator A from A li¬ 
near operator A* from is said to be the conjugate of the operator A 
if for any two vectors and y £ Y, 

(Ax, y) = (x, A*y). (7.0.1) 

Every operator A has a conjugate operator A* which is unique. 

Given a complex m X n matrix A, an n X m matrix A* is said 
to be the conjugate of the matrix A if 

a 6 = a-ii 

for all i, j. 

The conjugate operator has a corresponding conjugate matrix and 
vice versa with respect to every pair of orthonormal bases for the 
unitary spaces X and Y. In the case of the Euclidean spaces X and 
y, it can be shown that a similar relationship exists between the 
conjugate operators and the transposed matrices. 

Consider now the operators on a unitary space X for which the 
following theorem is true. 

The Schur theorem. For each operator A there is an orthonormal 
basis for the space X with respect to which the matrix of the operator 
is triangular. 

A number of important classes of operators on a unitary space X 
can be identified, using the notion of a conjugate operator. 

An operator A is said to be normal if 

A* A = AA*. (7.0.2) 

An operator U is said to be unitary if 

U*U = UU* = E. (7.0.3) 

An operator H is said to be Hermitian if 

//* = H. (7.0.4) 

An operator K is said to be skew Hermitian if 


K* = -K. 


( 7 . 0 . 5 ) 
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A Hermitian operator H is said to be positive-semidefinite(positive- 
definite) if for each non-zero vector x 

(Hx, *)>0 (>0). (7.0.6) 

We define normal, unitary, Hermitian, skew Hermitian, positive- 
semidefinite, and positive-definite matrices in exactly the same way 
and in the last two cases matrices can be identified, as usual, with 
operators on the arithmetic space. 

The following results hold for all the above classes of opera¬ 
tors: 

An operator A is normal if and only if there exists an orthonormal 
basis for it containing the eigenvectors. 

A normal operator A is unitary if and only if the moduli of all 
the eigenvalues are equal to unity. 

A normal operator A is Hermitian if and only if all its eigenvalues 
are real. 

A Hermitian operator // is positive-semidefinite (positive-defi¬ 
nite) if and only if all its eigenvalues are nonnegative (positive). 

Any operator A from (o xx may be represented as 

A = H x + iH t , (7.0.7) 

where H 1 and H 2 are Hermitian operators. This is called the Her¬ 
mitian decomposition of operator A . Moreover, 

H X =\(A + A*) t H 2 = ±(A-A*). 

In the Euclidean space X the relations (7.0.2)-(7.0.6) also iden¬ 
tify classes of operators which are called, respectively, normal, 
orthogonal, symmetric, skew-symmetric, positive-semidefinite, positive- 
definite. Matrices with the same names are defined in similar man¬ 
ner. 

The following definitions and results are true for both unitary and 
Euclidean spaces. 

If A is an operator with rank r from X to Y, then the nonzero 
eigenvalues of operators A* A and A A* coincide (taking their mul¬ 
tiplicity into account) and are positive. 

If n and m are the dimensions of spaces X and Y, respectively, 
then the multiplicity of the eigenvalue zero is equal to n — r for 
the operator A*A, and to m — r for the operator AA*. 

Let s=min (n, m) and denote the common eigenvalues of the 
operators A* A and A A* by a\, . . ., a) (a t ^ 0). The numbers 
a x , .... a, are then called the singular values of the operator A. 

The singular values of a matrix are defined similarly. 

In all cases orthonormal bases e lt . . ., e n and f 2 , . . ., f m (if 
A 6 “xrx:. then m = n) exist for an operator A such that: (1) the vectors 
e lt . . ., e„ are the eigenvectors of the operator A*A; (2) the vectors 
12* 
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/ lt .... / m are the eigenvectors of the operator AA*; (3) if e lt . . . 
. . ., e T and f x , are associated with nonzero numbers a*, . . 

. . a*, then 

.r. 

A pair of bases e lt . . ., e„ and f lt . . ., f m that possess these prop¬ 
erties is said to be a pair of singular bases for the operator A. 

It is possible to represent any operator A on a space X as the 
product of a positive-semidefinite and unitary (orthogonal) operator: 

A = HU. (7.0.8) 

This is called the polar representation of operator A. 

Assume that A is an operator from <o XT and b is a fixed vector 
in space Y. If the equality 

Ax'= b (7.0.9) 

is considered for finding vectors x from X, then the equation is 
consistent if and only if b 6 T A . Thus, the solutions of (7.0.9) are 
all pre-images of the vector b. If b £ T A , then it is sensible also 
to find the vectors x such that the vector 

y = b — Ax 

has the least possible length. These vectors x are called pseudoso¬ 
lutions of equation (7.0.9). The pseudosolution which has the least 
length is said to be the normal pseudosolution of the equation (7.0.9). 
It always exists and is unique. 

By considering equation (7.0.9) for all vectors b from Y, we can 
match the normal pseudosolution of the corresponding equation to 
each vector b and thus obtain a linear operator from Y to X. This 

operator is called pseudoinverse of the operator A and is denoted 

by A*. 

A quadratic form F in n real variables x v . . ., x„ is a function 
of the form 

Jj «!/*!*/. (7.0.10) 

where a l} are real numbers; we assume that a t] = a Jt . > 

If a symmetric matrix A of the coefficients a l} (called the matrix 
of a quadratic form) and a column vector x having the variables 
x x , . . ., x„ are constructed, then the definition of a quadratic form 
may be rewritten as 

F = (Ax, x). (7.0.11) 

The scalar product is defined here by the familiar rule (7.1.4) and 
the rank of a quadratic form F is the rank of the matrix A. 



7.0 


Terminology and General Notes 


181 


When the variables are changed by 

x = Py (7.0.12) 

the form F is transformed into a new quadratic form in the new 
variables y x , . . y n and the matrix B, defined by this form, is 
related to the matrix A by the relation 

B = P T AP. (7.0.13) 

This change of variables (7.0.12) is said to be nondegenerate if 
the matrix P is nondegenerate. The rank of a quadratic form remains 
unaltered by a nondegenerate transformation of its variables. 

Every quadratic form F of rank r may be reduced by a nondegene¬ 
rate transformation of variables to the form 

F = + ^2^* + • • • + A. r y£, (7.0.14) 

which is called the canonical form of F. Here X x , \ a * . . ., k r are 
all nonzero. 

Generally speaking, the canonical form of a given quadratic 
form is not uniquely defined. In particular, it is always possible 
to make nonzero coefficients equal to 1 or —1. Such a canonical form 
is called the normal form of the quadratic form and despite the 
ambiguity of the canonical form the following statement remains 
valid. 

The law of inertia of quadratic forms. The number of positive (and 
negative) coefficients among k lt . . ., X r is the same in each cano¬ 
nical form to which a given quadratic form may be reduced by 
a nondegenerate transformation of variables. 

The above-mentioned numbers are called, respectively, the posi¬ 
tive and negative indices of inertia, and their difference is said to be 
the signature of the quadratic form. 

Note that each quadratic form F may be reduced to the canonical 
form by an orthogonal transformation of variables (a transformation 
defined by an orthogonal coefficient matrix). For this it is sufficient 
to substitute an orthogonal matrix, whose columns are the eigen¬ 
vectors of the matrix A, for P in (7.0.12). The coefficients of the 
canonical form then obtained are the eigenvalues of A. 

A quadratic form (7.0.11) is called positive-definite if 
(Ax, x) > 0 

and when x =£ 0. A positive-definite form F becomes normal when 
F=yl-ty\-\----+yn- (7.0.15) 

Two quadratic forms F and G in the same variables may be redu¬ 
ced to a canonical form by one transformation if at least one of the 
forms (F, for example) is positive-definite. If in this case the trans¬ 
formation x = Py, which reduces the form F to a normal form 



Unitary Space Operators 


Ch. 7 


(7.0.15), is carried out first, then the form G is turned into some 
form in the variables y 1 , . . ., y„. Next the orthogonal transforma¬ 
tion y = Qz, which reduces G to a canonical form, is carried out; the 
form F still retains its normal form and is changed into F — z\ - I- 
+ + . . • + 

Note in conclusion that the symbols e"* are used in this chapter 
as a contracted way of writing the complex number z = cosr|> + 
+ i sin i|). 


7.1. Conjugate Operator. 

Conjugate Matrix 

In this section the following topics are considered: 

The definition and algebraic properties of conjugate operators and conjugate 
matrices. 

Examples of conjugate operators. 

The relation between conjugate operators and conjugate matrices with 
respect to orthonormal bases for the space. 

Relationships between the geometric characteristics of an operator A and 
the conjugate operator A* such as the kernel, image, eigenvalues, etc. 

It is stressed throughout that this property (two operators being conjugate) 
depends on the definition of the scalar product for a given linear space. 

7.1.1. Deduce the following properties from the definition of 
a conjugate operator: 

(i) (A*)* = A; 

(ii) (A + B)* = A* + B*; 

(iii) 0* = 0; _ 

(iv) M)* = aA*; 

(v) (AB*) = B*A *; 

(vi) E* = E\ 

(vii) if an operator A is nondegenerate, then (/4 -1 )* = (■d*) -1 ; 
(viii) (j4 m )* = (i4*) m for any whole nonnegative m\ 

(ix) if an operator A is nondegenerate, then the previous property 
is true for any whole number m; 

(x) if / (f) = a 0 + a x f + . . . + a m t m is an arbitrary polynomial, 
then 

[f{A)\* =f (A*), 

where f (t) = a 0 + a x t + ... + a m t m . 

7.1.2. Prove that the properties listed in the previous problem 
also hold for conjugate matrices. 

7.1.3. Show that for a nilpotent operator A with the nilpotence 
index g, the conjugate operator A* is also nilpotent and has the 
same nilpotence index. 

7.1.4. Show that if operators A and B commute, then the conju¬ 
gate operators A* and B* also commute. 
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7.1.5. Two bases e 2 , . . ., e n and q v . . ., q m for unitary (Eucli¬ 
dean) spaces X and Y, respectively, are held fixed. Assume that 
the following relations are valid for linear operators A and B 

{Ae h qj) = (e t , Bqj), i = 1, . . n; / = 1, . . m. 

Prove that in this case A* = B. 

7.1.6. Let e lt . . e n be an orthogonal (but not orthonormal 1) 
basis for a space X. Find the relationship between the matrices 
defined by an operator A from <>> xx with respect to this basis and 
the matrices of the conjugate operator A*. 

7.1.7*. Let an operator A be defined by a matrix A e with respect 
to a certain basis e 2 , . . e„ for a unitary (Euclidean) space X. 
Prove that with respect to the basis f x , which is biorthogo- 

nal to the basis e lt . . ., e n , the conjugate operator A* is defined 
by the conjugate matrix ( A e )*. 

7.1.8. If there is an operator A on the one-dimensional unitary 
(Euclidean) space, what does the transformation A*, which is conju¬ 
gate of A, constitute? 

7.1.9. Find the conjugate operator of the rotation of the Eucli¬ 
dean plane through an angle a. 

7.1.10*. Find the conjugate operator for the operator of the 
Euclidean three-dimensional space Ax = lx, a], where a is a fixed 
vector. 

7.1.11. The scalar product is given on the space of polynomials 
M 2 by the formula: 

(/. g) = «o&o + a if>i + a 2 b 2 , (7.1.1) 

>vhere / ( t) = a 0 + a 2 t + a 2 t 2 , g ( t) = b 0 + b x t + b 2 t 2 . Find all 
the matrices of the differential operator A and the conjugate opera¬ 
tor A* with respect to the basis: (a) 1, t, t z \ (b) ^t 2 — if, t 2 — 1, 
\t 2 +\f, (c) 1, t, 1 1 2 -\. 

7.1.12. On the space M 2 the scalar product is defined by: 

(/> g) = 1 (-D g (-1) + / (0) g (0) + / (1) g (1). (7.1.2) 

Find the matrix defined by the operator, which is conjugate to the 
differential operator, with respect to each of the bases listed in 
Problem 7.1.11. Compare the matrices obtained with the correspond¬ 
ing matrices of Problem 7.1.11. 

7.1.13. The scalar product on the space M 2 is given by the for¬ 
mula: 

a,g)=\nt)g{t)dt. 


( 7 . 1 . 3 ) 
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Find the matrix of the operator which is conjugate to the differen¬ 
tial operator with respect to each of the bases listed in Problem 
7.1.11. 

7.1.14. On the re-dimensional arithmetic space, whose elements 
are the column vectors, the natural scalar product is defined by: 

(x, y) = a 1 p 1 + . . . + a3 n . < (7.1.4) 

Here 



(the sign of complex conjugation is omitted in the real case). 

Show that if re X re matrices are identified with operators on this 
space as in Problem 5.6.7, then the conjugate operator of the ma¬ 
trix A is: (a) the transpose of the matrix A T in the case of the real 
space R„; (b) the conjugate matrix A* in the case of the complex 
space C n . 

7.1.15. Show that in the case of the Kronecker product A X B, 
the conjugate matrix is of the form A* X B*. 

7.1.16. Prove that if A is a square matrix, then for associated 
matrices the following relationship holds true 

(A*) p = (A p )*. 

7.1.17. Denote the spaces of real and of complex re X re matrices 
by Rnxn and C nXn i respectively, for which the scalar product is 
given by the formula 

(A, B)= ^a lJ b lJ . (7.1.5) 

(In the real case, the sign of the complex conjugation is omitted). 

Show that 

{A, B) = tr (B*A) = tr (AB*). (7.1.6) 

7.1.18. Show that on the spaces i? nX n and C nxn the conjugates 
to the operators G AB and F AB defined in Problem 5.6.10 are the 
operators G A * B . and F A * B *. 

7.1.19. Let A lt . . ., A n be fixed real re X re matrices. Consider 
the following operator A from R n to R n xn- 



Ax = a,^, + ... + a n A n . 
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The scalar product is defined according to (7.1.4). Show that the 
conjugate of an operator A is the operator 


B 


» = 


|, P, = tr (B T A t ) =-tr(AjB), i = l, ...,n. 


Extend this result to the complex case. 

7.1.20. Show that each linear functional / ( x ) on a unitary (Eucli¬ 
dean) space X may be defined as the scalar product 


/ (x) = (*, /), 


where / is a certain vector of the space being held constant for the 
given functional. 

7.1.21. Show that the conjugate to a projection operator is also 
a projection operator. 

7.1.22. Show that the conjugate to a reflection operator is also 
a reflection operator. 

7.1.23. Show that the rank of a conjugate operator A* equals 
the rank of the operator A. 

7.1.24. Prove that the kernel of an operator A* coincides with 
the orthogonal complement of the image of the operator A. 

7.1.25. In the three-dimensional Euclidean space, a Cartesian 
system of coordinates Oxyz is fixed. Let A be the projection operator 
on the coordinate plane and parallel to the straight line determined 
by the equations x = y = z. Find the conjugate operator A*. 

7.1.26. Find the kernel and image of the operator in the Af 2 -space 
which is conjugate to the differential operator, if the scalar product 
for M z is given by the formula: (a) (7.1.1); (b) (7.1.2); (c) (7.1.3). 

7.1.27. Prove the Fredholm theorem : a non-homogeneous system 
of linear equations Ax = b is consistent if and only if the column 
vector b is orthogonal to all the solutions of the conjugate homoge¬ 
neous system A*y = 0 (cf. 4.5.3). 

7.1.28. Prove the following Fredholm alternative : either a system 
of equations Ax = b is consistent, whatever the right-hand side b is, 
or the conjugate homogeneous system A*y = 0 has nonzero solu¬ 
tions. 

7.1.29. Prove that the kernel of an operator A*A coincides with 
the kernel of the operator A. 

7.1.30. Prove that the image of an operator A*A coincides with 
the image of the operator A*. 

7.1.31. Let operators A and B satisfy the equality B*A = 0. 
Prove that the images of these operators are orthogonal subspaces. 

7.1.32*. Prove that if AB* = 0 and B*A = 0, then the rank 
of the operator A -f B equals the sum of the ranks of the operators 
A and B. Moreover, the kernel of the operator A -f B is the inter¬ 
section of the kernels of the operators A and B. 
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7.1.33. Prove that if a subspace L of a unitary (Euclidean) space 
is yl-invariant, then its orthogonal complement L L is invariant 
under the conjugate operator A*. 

7.1.34*. On the space M„ of polynomials of degree ^ n, the 
scalar product is given by the formula , 

(/. = (7-1.7) 

where / (t) = a 0 -r a 2 t + . . . + a n t n , g (t)= b 0 + + • • • + 

4- b n t n . Describe all the invariant subspaces of the operator 
conjugate to the differential operator. 

7.1.35. The scalar product for M„ is determined by the formula: 

(/. D-S /(*)*(*)• (7.1.8) 

Find the n-dimensional invariant subspace of the operator which 
is conjugate to the differential operator. 

7.1.36. Solve a similar problem for the case when the scalar 
product for M n is defined by the formula 

l 

(f, g)= l f(t)g(i)dt. (7.1.9) 

7.1.37. Prove that in the unitary space of dimension n, each 
operator has: (a) an invariant subspace of dimension n — 1; (b) an 
invariant subspace of dimension k, 0 < k < n (cf. 6.3.9 and 6.3.36). 

7.1.38. Prove the following Schur theorem: for each operator A 
on a unitary space there exists an orthonormal basis with respect to 
which the matrix of the operator A is triangular (cf. 6.3.36). 

7.1.39. Find the Schur basis for the differential operator in 
the space M 2 if the scalar product of M 2 is determined by the formula: 
(a) (7.1.1); (b) (7.1.2); (c) (7.1.3). 

7.1.40*. Prove that commuting operators A and B on a unitary 
space have a common Schur basis with respect to which the matrices, 
defined by these operators, are triangular and have the same form. 

7.1.41. Find the relation between the eigenvalues of an operator 
4 on a unitary space and the conjugate operator A*. 

7.1.42. Let x be an eigenvector common to the conjugate opera¬ 
tors A and .4*. Prove that the eigenvalues \ and p of the operators 
A and A*, and associated with the vector x, are conjugate numbers. 

7.1.43. Let x be the eigenvector of an operator A, associated with 
an eigenvalue y is the eigenvector of the operator .4*, associated 
with an eigenvalue p, with p =^= X. Prove that the vectors x and y 
are orthogonal. 
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7.1.44*. Let K x and be root subspaces of operators A and A*, 
associated with eigenvalues A, and p, respectively, with p # A,. 
Prove that the subspaces Ky and K * are orthogonal. 

7.1.45. How are the Jordan forms of the conjugate operators A 
and A* related? 

7.1.46. Find the Jordan canonical bases for the differential ope¬ 
rator and its conjugate in the polynomial space M t , with the scalar 
product introduced as in (7.1.1). 

7.1.47*. Prove that the Schur basis for an operator A is defined 
ambiguously. Namely, for each sequence of the operator’s eigenva¬ 
lues A, lt . . ., A.„, there is an orthonormal basis for the unitary space 
with respect to which the matrix determining this operator not only 
is upper (lower) triangular, but also has eigenvalues Ai ( positioned 
on the main diagonal in the original sequence. 


7.2. Normal Operators and Matrices 

We discuss here various properties of normal operators and normal matrices. 
The most important of these is, certainly, the existence of an orthonormal basis 
for these operators and matrices that is made up of the eigenvectors. The greater 
part of the problems are devoted to just this fact. Further, we wished to illustrate 
the following important statement: of all operators of simple structure, the 
normal operators are peculiar with respect to the scalar product defined on the 
space, since the basis for these, being made up of the eigenvectors, is orthogonal, 
and not merely arbitrary. If, however, the scalar product on this space is defined 
in another way then those linear operators that were normal would cease to be 
such, generally speaking, and conversely, another subset of the operators of 
simple structure would become the class of normal operators. 

7.2.1. Show that any scalar operator of a unitary (Euclidean) 
space is normal. 

7.2.2. Show that if A is a normal operator, then the following 
operators are also normal: (a) aA, where a is any number; (b) A h , 
where k is any natural number; (c) / (.4), where / (f) is an arbitrary 
polynomial; (d) A~ l , if A is nondegenerate; (e) A*. 

7.2.3. Give examples demonstrating that the sum A + B and 
product AB of normal operators A and B are not, generally speaking, 
normal operators either. 

7.2.4. Show that the matrix of a normal operator with respect 
to any orthonormal basis is also normal. Conversely, any normal 
matrix defines a normal operator with respect to that basis. 

7.2.5. Give examples demonstrating that the matrix of a normal 
operator with respect to a non-orthogonal basis (a) may prove not 
to be normal; (b) may be normal. 

7.2.6. Show that any linear operator in a one-dimensional unitary 
(Euclidean) space is a normal operator. 

7.2.7. Show that rotation operator on the Euclidean plane is a 
normal operator. 
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7.2.8. Show that an operator on the three-dimensional Eucli¬ 
dean space, such that Ax = [ x , a), is normal. 

7.2.9. Show that the following operators on the space .l/„ of poly¬ 
nomials with the scalar product (7.1.7) are normal: 1 

(a) / (<) -*~f (—0; 

(b) f(t) 

7.2.10. Prove that any circulant is a normal matrix. 

7.2.11. Let A = B + iC be a normal complex matrix of order 
n. Prove that the real matrix D of order 2 n 



is also normal. 

7.2.12. Prove that if the rows and columns of a normal matrix 
are considered as vectors of the arithmetic space with the natural 
scalar product (7.1.4), then (a) the length of the i-th row equals the 
length of the i-th column; (b) the scalar product of the i-th and ;-th 
rows equals the scalar product of the ;-th and i-th columns (in the 
indicated order). 

7.2.13. Prove that a quasi-triangular normal matrix is neces¬ 
sarily quasi-diagonal. 

7.2.14. Prove that if A is a normal matrix, then the associated 
matrix A p is also normal. 

7.2.15. Prove that the sum of the squares of the moduli of all 
minors of order k, selected from the rows i lt . . ., i* of a normal 
matrix A, equals a similar sum of the minors selected from the 
columns with the same indices. 

7.2.16. Prove that the Kronecker product of normal matrices A 
and B (perhaps, of different orders) is also a normal matrix. 

7.2.17. Let A and B be normal matrices of order n X n. Prove 
that the operators G AB and F AB (see Problem 5.6.10) are normal 
operators on the space C nx „ (N nx „). 

7.2.18. Prove that if A is a normal operator, then for any vector 
x, the following equality is true 

\Ax | = \A*x |. (7.2.2) 

7.2.19. Prove that the kernel of a normal operator is the orthogo¬ 
nal complement to its image. 

7.2.20*. Prove the following statement: for an operator A on a 
unitary space to be normal, it is necessary and sufficient that the 
image and kernel of the operator A — kE, where k is any number, 
should be orthogonal. Is a similar statement valid for a Euclidean 
space? 

7.2.21. Prove that a projection operator P is normal if and only 
if the image and kernel of this operator are orthogonal. If this is 
the case, the operator P is called an operator of orthogonal projection. 
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7.2.22. Let A and B be normal operators, and AB = 0. Do these 
conditions imply the equality BA = 0? 

7.2.23. Prove that any eigenvector of a normal operator A is 
also an eigenvector of the conjugate operator A*. 

7.2.24*. Prove the statement converse to that in Problem 7.2.23: 
if each eigenvector of an operator A on a unitary space is also an 
eigenvector of the conjugate operator A* the operator A is normal. 

7.2.25*. Prove that each invariant subspace of a normal opera¬ 
tor A is also invariant with respect to A*. 

7.2.26. Prove that an operator, induced on an arbitrary inva¬ 
riant subspace by a normal operator, is also normal. 

7.2.27. Show that the eigensubspaces of a normal operator are 
orthogonal to one another. 

7.2.28. Prove that the operator R of reflection in L x parallel to 
Z >2 is normal if and only if the subspaces L x and L 2 are orthogonal. 
In this case R is called an orthogonal reflection operator. 

7.2.29. Can a normal operator have a nonorthogonal basis made 
up of the eigenvectors? 

Verify that the matrices, indicated below, are normal and find, 
for each of them, an orthonormal (in the sense of (7.1.4)) basis of 
eigenvectors: 

7.2.30. |J ‘ |. ,2.3, |_0 J _,| 

II—1 2 Oil 

1 0 || 7.2.33. 

1-* 1 . 


7.2.34. Can the scalar product be defined on the space Af„ (n> 1) 
so that the differential operator is normal? 

7.2.35. An operator on the space of polynomials M„ (n ^ 1), 
/ (t) -*-f (t + a) (where a is a certain fixed number), is considered. 
Can the scalar product on M„ be defined so that this operator is 
normal? 

7.2.36. Let X be an arbitrary linear space. Prove that for any 
operator A of simple structure on X the scalar product on X may 
be defined so that A is normal. 

7.2.37*. An operator A on the arithmetic space R 3 has the matrix 
1 1 1 

0 0 1 

0 0-1 

with respect to the standard basis. Define the scalar product on R 3 
so that the operator A is a normal operator. 


7.2.32*. | 2-< - 
—1 

0 


1111 
11 - 1-1 
- 11-1 1 • 

-11 1-1 
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7.2.38*. Prove that an operator A is a normal operator if and 
only if the conjugate operator A* can be represented by a polynomial 
of A. 

7.2.39. Let A be a normal operator, and let A commute with 
some operator B. Prove that (a) A* commutes with B; (b) A com¬ 
mutes with B*. 

7.2.40. Prove that the commuting normal operators A and B 
have a common orthonormal basis composed of their eigenvectors. 

Verify that the matrices A and B, indicated below, are normal 
and commuting and construct a common orthonormal basis of 
their eigenvectors for them: 


0 1 1 


0 1 —1 

1 0 1 

1 1 0 

, B = 

—1 0 1 

1—1 0 


1 + 5, -i + i i_, 



7.2.43. Prove that the operators A + B, AB, and BA (see 
Problem 7.2.40) arc normal as well as the operators A and B. 

7.2.44*. Prove the following statement which contrasts slightly 
to that of Problem 7.2.43: if A, B, and AB are normal operators, 
and at least one of the operators A or B has not only simple but 
different in modulus eigenvalues then A and B are commuting. 

7.2.45*. Prove the following strong version of the statement of 
Problem 7.2.44, viz. that if A, B, and AB are normal operators, and 
at least one of the operators A or B has no different eigenvalues 
with equal moduli, then A and B are commuting. 

7.2.46. Give an example of normal operators A and B for which 
the operators AB and BA are normal and different. 

7.2.47. The maximum value of the moduli of the eigenvalues 
A,,, . . ., A n of an operator A 


p(i4) = max|A. ( | 

is called its spectral radius. Prove the following estimate of the 
extreme value for the spectral radius of a normal operator A: 


p(A) = 


*=*0 


\(Ax, *)| 
(*. -v) * 


What can be said about vectors for which such a maximum occurs? 
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7.2.48. Prove that the following estimate of the spectral radius of 
a normal n x n matrix A is valid 

pM)>v| 2 a u\- 

7.2.49. Prove that for the spectral radius of a normal operator A 
the formula is valid 

P iA) — max • 

Is it correct to say that each vector x, for which the indicated equa¬ 
lity occurs, is an eigenvector of the operator A? 

7.2.50*. Let R be a Euclidean space, C a unitary space obtained 
from R by complexification (see Problem 2.5.14). Show that the 
correspondence between the operators A of the space R and the 
operators 2 of the space C (see Problem 5.1.52): (a) assigns the conju¬ 
gate operator A* to the conjugate operator A*; (b) assigns the nor¬ 
mal operator A to a normal operator A. 

Using (b), show that if X is an eigenvalue for a normal operator A, 
then its geometric and algebraic multiplicities coincide. 

7.3. Unitary Operators and Matrices 

The first part of the section is devoted to unitary operators. We shall be 
especially concerned with the following two of their properties: the spectral 
characteristic (unitary operators are normal operators all of whose eigenvalues 
have unit moduli), and the preservation of the scalar product. 

In the second part of the section we consider unitary matrices. Having dis¬ 
cussed their formal properties, we introduce the notion of unitarily similar 
matrices and formulate the matrix analogues of a number of propositions that 
have already been proved for the operators. Finally, we demonstrate some impor¬ 
tant computational applications of certain unitary matrices of special form. 

7.3.1. Show that the set of all unitary operators from forms 
a group under multiplication. 

7.3.2. Show that the sum of unitary operators is not, generally 
speaking, a unitary operator. 

7.3.3. Show that the product of a unitary operator by a number a 
is a unitary operator if and only if | a | = 1. 

7.3.4. Describe all the unitary operators on a one-dimensional 
space. 

7.3.5. Show that an operator that rotates the Euclidean plane 
is an orthogonal operator. 

7.3.6. Is the operator Ax = hr, a ] on a three-dimensional Eucli¬ 
dean space orthogonal? 

7.3.7. Show that the operators of Problem 7.2.9 are orthogonal. 

7.3.8. Let the scalar product on the space M n (n 1) be defined 



Unitary Space Operators 


Ch. 7 


by formula (7.1.9). Are the operators mentioned in Problem 7.2.9 
orthogonal on such a Euclidean space? 

7.3.9. Let A be a normal operator on a three-dimensional unitary 
space. Prove that if the eigenvalues X lt X 2 , X 3 of this operator con¬ 
sidered as points in the complex plane are not in the same straight 
line, then the operator A can be represented in the form 

A =aE + p U, 

where U is a unitary operator and a is a complex number, p > 0. 

7.3.10. Can a projection operator be unitary? 

7.3.11. Show that an orthogonal reflection operator is a unitary 
operator. 

7.3.12. Show that the operators mentioned in Problem 7.2.9 
are orthogonal reflection operators. Find the eigensubspaces of 
«ach of them. 

7.3.13*. An operator A on the space M 2 has the matrix 



with respect to the basis 1, t, t 2 . Show that A is a reflection operator. 
Define the scalar product on M t so that A becomes an orthogonal 
operator. 

7.3.14. Prove that a normal operator A , fulfilling the condition 
A h = E (where A is a certain whole number k 0), is a unitary 
operator. 

7.3.15. Prove that the modulus of the determinant of a unitary 
operator equals unity. 

7.3.16*. An orthogonal operator Q on the space of polynomials 
M 2 with the scalar product (7.1.1) transforms the polynomials 
1 + t + t 2 and 1 — t 2 into —1 — t + t 2 and 1 — t, respectively. 
The determinant of this operator equals —1. Find its matrix with 
respect to the basis 1, t, t 2 . 

7.3.17. Prove that if U is a unitary operator, then for any vectors 
x and y 

(Ux, Uy) = (x, y), 

i.e. the unitary operator preserves the scalar product. Conversely, 
if a certain linear operator U preserves the scalar product of any 
two vectors, then U is a unitary operator. 

7.3.18. An operator on the arithmetic space 7? 4 with the scalar 
product (7.1.4) transforms the vectors Xj = (2, 2, 2, 2,), x 2 = 
= (2, 0, 2, 2), x 3 = (2, 2, 0, 2), x 4 = (2, 2, 2, 0), respectively, into 
the vectors j h = (4, 0, 0, 0), y 2 = (3, —1, 1, 1), y 3 = 
=(3, 1, —1, 1), j/ 4 =(3, 1, 1, —1). Is this operator orthogonal? 
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7.3.19. Prove that for a linear operator on a space X to be uni¬ 
tary, it is necessary and sufficient that it should preserve the scalar 
products of the vectors of a certain basis for the space X. In particu¬ 
lar, an operator is unitary if it transforms an orthonormal basis 
into another orthonormal basis. 

7.3.20*. Prove that for a linear operator U on a space X to be 
unitary, it is sufficient that U should preserve the lengths of all 
vectors from X. 

7.3.21*. Prove that a linear operator preserving the orthogonal¬ 
ity of any two vectors differs from a certain unitary operator only 
by a numerical multiplier. 

7.3.22. Prove that the requirement of a matrix U to be unitary 
is equivalent to the requirement that the columns (or rows) of U, 
considered as vectors of the arithmetic space with the scalar product 
(7.1.4), form an orthonormal basis for this space. 

7.3.23. Prove that any permutation matrix is a unitary matrix. 

7.3.24. Prove that the modulus of each element of a unitary 
matrix equals its complementary minor. 

7.3.25. Let U = P + iQ be a complex unitary matrix of order n. 
Prove that the real matrix of order 2 n 



is orthogonal. 

7.3.26. Prove that if U is a unitary matrix, then the associated 
matrix U p is also unitary. 

7.3.27. Prove that the sum of the squares of the moduli of all 
minors of order k, selected from arbitrary k rows (or columns) of 
a unitary matrix, equals unity. 

7.3.28. Let the modulus of the leading principal minor of order 
k of a unitary matrix U equal unity. Prove that in this case U is 
of quasi-diagonal form 


where U u is a block of order k. 

7.3.29. Prove that the Kronecker product of unitary matrices 
U and V , being, perhaps, of different orders, is also a unitary matrix. 

7.3.30. Let U and V be unitary matrices of order n X n. Show that 
(a) the operator G uv (see Problem 5.6.10) is unitary; (b) the operator 
Fw is not, generally speaking, unitary. 

7.3.31. Prove that the transfer matrix, from an orthonormal 
basis into another orthonormal basis for a unitary space, is a uni¬ 
tary matrix. 

7.3.32. Matrices A and B are said to be unitarily similar if there 
exists such a unitary matrix U that B = U~ l A U. Show that the 


13-0019 
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relation of unitary similarity on the set of square matrices of a given 
order n is reflexive, symmetric, and transitive. 

7.3.33. Prove that any complex matrix is unitarily similar to 
a triangular matrix. 

7.3.34. Prove that an upper triangular matrix is unitarily simi¬ 
lar to some lower triangular matrix. 

7.3.35. Show that a unitarily similar transformation transforms 
a normal matrix into another normal matrix. 

7.3.36. Show that a complex normal matrix is unitarily similar 
to a diagonal matrix. 

7.3.37. Find a condition for a matrix of the form 


i-th row 


cos<p-e 1 ’ i ’ 1 ... — sin 


/-th row 


sinjp-e 1 ^* ... costp-e*’ 1 ’ 4 


(7.3.1) 


l 


to be unitary (the off-diagonal elements, that are not indicated, 
are equal to zero). The unitary matrix obtained is called an ele¬ 
mentary unitary matrix and is further denoted by T i} . 

7.3.38. Let k be a square matrix of order n (n^ 2). Select an 
elementary unitary matrix T t} so that the (/, i) element of the 
matrix B = T {J A is equal to zero. In this way we may put ip! = i|' 4 = 0 
(see Problem 7.3.37). 

7.3.39. Given an n-order matrix A, how should such a sequence 
of elementary unitary matrices T w , r< 2 >, . . ., be chosen so that 
all the elements of the first column below the diagonal of the prod¬ 
uct . . . T^TWA are equal to zero? 

7.3.40*. Using Problems 7.3.38 and 7.3.39, indicate a method 
to decompose a square matrix into the product of a unitary and upper 
triangular matrices. 

7.3.41. Prove that any unitary matrix can be decomposed into 
the product of elementary unitary matrices and, perhaps, by a {di¬ 
agonal unitary matrix. 

7.3.42. Let A = U 1 R 1 and A = U 2 R 2 be two decompositions 
of a nondegenerate matrix A into the product of a unitary and upper 
triangular matrix. Prove that 

U 2 = U,Q, R, = QR 2 , 
where Q is a certain diagonal unitary matrix. 
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7.3.43. How should the method derived in Problem 7.3.40 be 
applied to the solution of a system of linear equations Ax = b with 
a square nondegenerate coefficient matrix? 

7.3.44. Find a condition for a column vector w so that a matrix 
of the form 

H = E - 2 ww* (7.3.2) 

is unitary. 

7.3.45. Let w be a normalized column vector. Prove that the 
corresponding matrix (7.3.2), treated as an operator on the artithmet- 
ic space, defines an orthogonal reflection in it. Such a matrix H 
is called a reflection matrix. 

7.3.46. Find the eigenvalues and eigenvectors of a reflection 
matrix. 

7.3.47. Find the determinant of a reflection matrix. 

7.3.48. Show that any unitary matrix all of whose eigenvalues 
are +1 and —1, —1 being an eigenvalue of multiplicity unit, can 
be represented in the form (7.3.2). 

7.3.49. Show that the matrix 

7* _ II cos «p simp 
|| sin <p — cos<p 

is a reflection matrix. Find the corresponding vector w. 

7.3.50. Let H be a reflection matrix whose vector w is known. 
How should the product of the matrix H by a column vector x be 
computed so that this operation requires performing only (2 n -f 1) 
multiplication operations? 

7.3.51. Select the vector w so that the reflection matrix, defined 
by it, transforms a given vector x into a vector collinear to the 
unit column vector e t (we assume that the vector x itself is not colli¬ 
near to e,). 

7.3.52*. Use the result of Problem 7.3.51 to construct an algo¬ 
rithm that decomposes a square matrix into the product of a uni¬ 
tary and an upper triangular matrix. 

7.3.53. Let Ax = b be a system of linear equations with a non¬ 
degenerate square matrix A. Describe a method to solve this system 
based on the procedure derived in Problem 7.3.52. 

7.3.54*. Let A be a square matrix of order n (n > 2). How should 
such a reflection matrix H be selected so that the matrix B = 
= HAH * has zeroes for all the elements of the first column from 
the third element down? 

7.3.55. A square matrix B is said to be upper (lower) almost trian¬ 
gular if b u = 0 for i > + 1 (/ > i + 1). Using the result of 

Problem 7.3.54, show that any square matrix is unitarily similar 
to an upper (lower) almost triangular matrix. Restate this state¬ 
ment in the language of operators. 
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7.4. Hermitian Operators and Matrices 

In the first half of the section, we discuss the simplest properties of Hermitian 
operators and matrices. The sequence of the problems is determined by the same 
principles as in the previous sections. The second half comprises the problems 
concerning the eigenvalues of Hermitian operators. A special consideration is 
given to their remarkable extreme properties. The application of these proper¬ 
ties enables one of the most effective computational techniques for finding the 
eigenvalues of Hermitian matrices to be used, i.e. the method of bisection which 
is described in Problems 7.4.43-7.4.48. 

7.4.1. Show that the set of all Hermitian operators from 
forms a group under addition. 

7.4.2. Show that the set of all symmetric operators from the 
linear space of all linear operators on a Euclidean space X is 
a linear subspace. A similar statement is valid for the set of all 
skew-symmetric operators from & X x- 

7.4.3. Show that the product of a nonzero Hermitian operator 
and a number a is a Hermitian operator if and only if a is a real 
number. 

7.4.4. Show that an operator K is skew Hermitian if and only if 
the operator iK is Hermitian. 

7.4.5. Show that the product of Hermitian operators H x and H 2 
is a Hermitian operator if and only if H x and H 2 commute. 

7.4.6. Show that the inverse operator of a nondegenerate Hermi¬ 
tian operator is also Hermitian. 

7.4.7. Describe all the Hermitian operators that act on a one¬ 
dimensional space. 

7.4.8. A linear operator A is defined on a two-dimensional Eucli¬ 
dean space and for two particular noncollinear operators x and y 

(Ax, y) = (x, Ay). 


Prove that A is a symmetric operator. 

7.4.9. Show that the operator Ax = [x, a] on a three-dimensional 
Euclidean space is skew-symmetric. 

7.4.10*. Prove that any skew-symmetric operator AT of a three- 
dimensional Euclidean space can be represented in the form Kx = 
= [x, a\ having selected a convenient vector a. 

7.4.11. An operator on the arithmetic space R t with the scalar 
product (7.1.4) converts the vectors x x = (0, 1, 1, 1), x 2 = 
= (-1, 0, 1, 1), Xg = (-1, -1, 0, 1), x 4 = (-1, -1, -1, 0) 
into the vectors y x = (3, —1, —1, —1), y 2 = (1, —3, —1, —1), 

= (—1, —3, —1, 1), y t = (—3, —1, —1, 1), respectively. Is 
this operator symmetric? 

7.4.12. Show that the operators of Problem 7.2.9 are symmetric. 

7.4.13. Show that any orthogonal reflection operator is Hermitian. 
In particular, the reflection matrix (7.3.21 is Hermitian. 
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7.4.14. Show that an operator, both unitary and Hermitian, 
is either equal to ±E or is an orthogonal reflection operator. 

7.4.15*. A symmetric operator S on the space lif 2 of polyno¬ 
mials with the scalar product (7.1.1) transforms the polynomials 
2 + 2 t — t 2 and 2 — t + 2t 2 into 5 — t — t 2 and 3 + 3* + 3 t 2 , 
respectively. The trace of this operator is equal to 3. Find the ma¬ 
trix with respect to the basis 1, t, t 2 . 

7.4.16. Let H 1 and H 2 be complex Hermitian matrices of the 
same order. Prove that the trace of the matrix HyH t is a real number. 

7.4.17. Let a Hermitian matrix H be represented in the form 
H = S + iK, where S and K are real matrices. Show that S is 
a symmetric, and K a skew-symmetric matrix. 

7.4.18. Prove that the real matrix (see Problem 7.4.17) 



is symmetric. 

7.4.19. Prove that if H is a Hermitian matrix, then the associated 
matrix H p is also Hermitian. 

7.4.20. Prove that the Kronecker product of Hermitian matrices 
Hy and H 2 of different orders, perhaps, is also a Hermitian matrix. 

7.4.21. Let IIy and H z be Hermitian matrices of order n X n. 
Show that the operators G HlH , and F HlHt (see Problem 5.6.10) are 
Hermitian. 

7.4.22. Prove that if an operator II is Hermitian, then for an 
arbitrary vector x the scalar product ( Hx , x) is a real number. 

7.4.23. Let K be a skew-symmetric operator on a Euclidean 
space X. Prove that (Kx, x) = 0 for any vector x from X. 

7.4.24. What can be said about a Hermitian operator H if 
(Hx, x) = 0 for all vectors x? 

7.4.25. Show that if the equality (Hyi, x) — (// 2 x, x) is valid 
for Hermitian operators Hy and // 2 and any vector x, then Hy = H 2 . 

7.4.26. Prove the statement, converse to that in Problem 7.2.18, 
viz., that if the equality (7.2.2) holds for any vector x, and A is 
a linear operator, then A is a normal operator. 

7.4.27. The eigenvalues of a normal operator A on a unitary space 
belong to the same straight line of the complex plane. Prove that 
the operator A can be represented in the form 

A — aE + a H, 

where H is a Hermitian operator, a and a are complex numbers, 
| oc | = 1. 

7.4.28. Show that the eigenvalues of a skew-Hermitian operator 
are pure imaginary numbers. 

7.4.29. Show that an orthogonal projection operator is a Hermi¬ 
tian operator. 
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It is assumed in Problems 7.4.30-7.4.37 that the eigenvalues 
A lt . . ., A„ of a Hermitian operator (or a Hermitian matrix) H are 
numerated so that 

■ ->K (7.4.1) 

If, besides the eigenvalues, an orthonormal basis e t , . . ., e n con¬ 
sisting of the eigenvectors of the operator H is considered, then 
the enumeration of its vectors will be assumed to correspond to the 
same ordering (7.4.1). 

7.4.30. Prove the validity of the following representations of 
the maximum and minimum values of a Hermitian operator H : 

A, = max ( f*' , A„ = min ■ ( f i i-jL • (7.4.2) 

Show that the vectors for which the indicated extreme values occur 
are eigenvectors of the operator H. 

7.4.31. Show that the extreme eigenvalues of a Hermitian ma¬ 
trix H satisfy the relations: 

Aj^max/i l( , A„ ^ min 

7.4.32. Assume that the equality A, = h u holds for a Hermitian 
matrix H. Prove that all the oB-diagonal elements of the i-th row 
and i-th column of the matrix H are zeroes. 

7.4.33. Prove that for the linear subspace L drawn on the eigen¬ 
vectors e ti , . . ., e, h (ij < . . . < i h ) of a Hermitian operator H, 
the following relations are valid: 

\ = m a X r ' *> , A,. = min {I * X ' f . (7.4.3) 

1 **0 (*• *) ’ X9*0 (*. *> V ' 

xGL x£L 

7.4.34*. Prove the following Courant-Fischer theorem : an eigen¬ 
value Aft of a Hermitian operator H on an n-dimensional space X 
satisfies the conditions 

minP-4.4) 

L h x*.0 X > 

x£L k 

Aft = min max f . (7.4.5) 

The maxima must be found for all fc-dimensional subspaces L h of 
the space X for use in the equality (7.4.4); similarly, L n _ htl in 
(7.4.5) means an arbitrary subspace of order n — k + 1. 

7.4.35*. Let H be an arbitrary principal submatrix of an 
n-order Hermitian matrix H. Using the Courant-Fischer theorem, 
prove that the eigenvalues p,, . . ., p„_, of the matrix H n _ x enume¬ 
rated in descending order separate the eigenvalues of the matrix H. 
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This means that 


^1^ ^2^ 1*2^ • • • ^ -1 ^ Hn-1 ^ ^n• 

7.4.36. Without computing the eigenvalues for the re-order 
matrix H 


0 0 ... 0 1 

0 0 ... 0 2 


0 0... 0 n — 1 

1 2 ... n — 1 n 


indicate the number of nonzero eigenvalues and their signs. 

7.4.37. Let the rank of a Hermitian matrix If be two greater 
than the rank of the principal submatrix H n . v Prove that the ma¬ 
trix H has one positive and one negative eigenvalue more than 
H n _j. 

7.4.38. Let the eigenvalues of Hermitian operators H v H 2 and 
H 2 + H 2 be enumerated in descending order 

ff 2 — <*!> a 2 > . . . > a n , 

^ 2 -Pl>P 2 >. • ->P». 

(7.4.6) 

#1 -f H 2 — Yl> V2> • •• > Vn- 

With the aid of the Courant-Fischer theorem, prove that the follow¬ 
ing inequalities are true (k = 1. 2, . . ., re): 


Yk^«iT Pa, Ya< <Xa + Pi, 

7a ^ a n T Pa, Va^S* «A + Pn- 

7.4.39. Show that by a unitary similar transformation, a Her¬ 
mitian matrix is reduced to another Hermitian matrix. 

7.4.40. A band matrix is said to be tridiagonal if the band width 
equals 3. Deduce the following corollary to Problem 7.3.55: any 
Hermitian matrix is unitarily similar to a tridiagonal matrix. 
Restate this proposition in the language of operators. 

7.4.41. We call a tridiagonal matrix C irreducible if c tj ^= 0 
when | i — j | = 1. Prove that if a tridiagonal Hermitian matrix 
has an eigenvalue A, of multiplicity r, then it is quasi-diagonal and, 
moreover, that there are at least r irreducible submatrices of lesser 
order on the diagonal. 

The following Problems 7.4.42-7.4.49 concern a given tridiago¬ 
nal irreducible Hermitian matrix C of order re, for which a sequence 
of polynomials /„ (A,), f 2 (A,), A.) is considered, where 

/„ (A) = 1, and /, (A,) is the characteristic polynomial of the leading 
principal submatrix C t of the matrix C (so that the polynomial 
f t (A) is of degree i). The iteration formulae, connecting the polyno- 
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mials of this set, were derived in Problem 3.2.46 (in the Hermitian 
case under consideration, C| = b t ), and are used from now on 
without further reference. The roots of the polynomial / { (A,), i.e. 
the eigenvalues of the submatrix C, are denoted by A*'*, . . ., A (i) 
and enumerated in descending order so that A 1 , 0 ^ A<°^ . . . 
. . . ^ A^ (however, see Problem 7.4.43, (b)), whereas Aj[ n) = A jt 
i = l, . . ., n. 

7.4.42. Construct a sequence of polynomials /„ (A), / x (A), . . . 
. . ., /j (A) for the matrix 


0 10 0 0 
10 10 0 
0 10 10 
0 0 10 1 
0 0 0 1 0 


(7.4.7) 


7.4.43. Prove that in the set of polynomials /„ (A), /j (A), . . . 
. . ., /„ (A): (a) adjacent polynomials have no common roots; (b) 
the roots of a polynomial /, (A), 1, strictly separate 

the roots of the polynomial f l+1 (A): 

A ( i ,+ 1) >AV ) >A^ ,+ ,) >A ( 2 ,) > ... >A ( , i+,) >Ai i) >A‘ , + + i 1) ; 


(c) if A^>, i < n, is a root of a polynomial f t (A), then the numbers 
fi-i (A* 0 ) and f l+1 (A* 0 ) have different signs. 

7.4.44*. A real number p is not a root of any polynomial /j (A). 
Prove that the number of changes of sign in the number sequence 

/o 00. fi 00. . . M /» 00 (7.4.8) 

equals the number of the eigenvalues of the matrix C (i.e. the roots 
of the polynomial /„ (A)) which are strictly greater than p. 

7.4.45*. Now let the number p be a root of the polynomials in 
the set / 0 (A), / x (A), ...,/„ (A). As before, count the number of 
changes of sign in the sequence (7.4.8), ascribing the sign of the 
number f l . 1 (p) to each zero value f t (p). Prove that the statement 
of Problem 7.4.44 remains valid in this case also. 

7.4.46*. Given that an eigenvalue A* of matrix C lies in an inter¬ 
val (a, b). In this case A* is said to be localized in (a, b). How, 
using the results of Problems 7.4.44 and 7.4.45, can A h be localized 
in an interval of half the length? 

7.4.47. Let all eigenvalues of a matrix C lie in an interval (m, M). 
Using the result of Problem 7.4.46, indicate a method of finding 
the numbers A { to the accuracy of a given member e. 

7.4.48. Show that the sequence (7.4.8) can be computed by per¬ 
forming only 2 (n — 1) operations of multiplication (assuming that 
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the | b t | 2 , in the iteration formulae connecting the polynomials 
/, (X), are already evaluated). 

7.4.49. The method of evaluating the eigenvalues of a tridiagonal 
Hermitian matrix derived in Problem 7.4.47 is termed the bisection 
method. Perform the bisection method for computing the greatest 
eigenvalue of the matrix (7.4.7) to the accuracy of e = 1/16. 

7.4.50*. Using the results of Problems 7.4.40, 7.4.41, 7.4.47, 
describe a method for approximating the eigenvalues of an arbitrary 
Hermitian matrix. 

7.4.51*. A tridiagonal irreducible matrix A is said to be Jaco¬ 
bian if flj, (+1 a /+li , > 0 for all i. Show that for Jacobian matrices 
with real diagonal entries the results of Problems 7.4.43-7.4.47 are 
valid. 

7.4.52. Using the correspondence between operators on a Eucli¬ 
dean space R and a unitary space C, obtained from R by complexifi- 
calion, prove that (a) a Hermitian operator S on the space C cor¬ 
responds to a symmetric operator S on the space R; (b) for any 
symmetric operator on the space R, there is an orthonormal basis 
for R such that the matrix of this operator, with respect to this ba¬ 
sis, is diagonal. 

Reformulate statement (b) for matrices. 

7.4.53. Let z v . . ., z„, Zj = x } + iyj be an orthonormal basis 
of the eigenvectors of a Hermitian matrix of order n X n II = 
= S -f iK, and X,, . . ., X„ be the corresponding eigenvalues. 
Prove that the 2n-dimensional column vectors u v v x , . . ., u„, u„, 
where 



form an orthonormal basis of the eigenvectors of a real matrix 



whose corresponding eigenvalues are Xj, X,, X 2 , X 2 , . . ., X„, X„. 


7.5. Positive-Semidefinite 
and Positive-Definite Operators 
and Matrices 

This section mostly deals with: 

The formal properties of positive-semidefinite and positive-definite operators 
which follow from the definition directly. 

Positive-definite matrices and Gram matrices. In this part of the section, 
we show that positive-definite matrices are, in a sense, a universal means of 
defining a scalar product on a given linear space. 

The nonnegativeness (positiveness) of the eigenvalues of a positive-semi¬ 
definite (positive-definite) operator (matrix). 
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Various criteria for the positive definiteness of Hermitia 1 matrices, and, 
in particular, the diagonal dominance (see Problem 7.5.24), the Sylvester cri¬ 
terion, etc. We also provide computational problems on their use. 

The relation of a partial ordering on the set of Hermitian operators. 

The square root of a positive-semidefinite numerical operator and some 
examples on evaluating the square root. 

Finally, applications of an important theorem about the eigenvalues of an 
operator HS, where H and S are Hermitian operators, and S is positive-definite. 

7.5.1. Can a positive-definite operator H convert a nonzero vector 
x into a vector y, orthogonal to x? 

7.5.2. Deduce from the definition that a positive-definite operator 
is nondegenerate. 

7.5.3. Let H be a positive-definite operator on a Euclidean space 
X. Show that for any nonzero vector x from X , its image makes 
an acute angle with x. 

7.5.4. Let H and S be positive-semidefinite operators. Show that 
for any nonnegative numbers a and (3, the operator aH + pS is 
positive-semidefinite. 

7.5.5. Let H and S be positive-semidefinite operators, and assume 
that for certain real numbers a 0 and p o the operator a 0 H + p o S 
is positive-definite. Show that in this case, all operators aH + PS 
{where a and p are arbitrary positive numbers) are positive-definite. 

7.5.6. Prove that the inverse operator of a positive-definite 
operator is also positive-definite. 

7.5.7. Show that any orthogonal projection operator is a positive- 
semidefinite operator. 

7.5.8. Let H be a complex positive-definite matrix. Prove that 
the transpose of H, i.e. H T , is also positive-definite. 

7.5.9. Prove that any principal submatrix of a positive-semidefi- 
nile (positive definite) matrix is also positive-semidefinite (positive- 
definite). 

7.5.10*. Let x x , . . ., x h be an arbitrary vector set of a unitary 
(Euclidean) space X. Prove that the Gram matrix of the set x lt ... 
. . ., x k is a positive-semidefinite matrix. This matrix is positive- 
definite if the set x x , . . ., x k is linearly independent. 

7.5.11. Let e lt . . ., e„ be an arbitrary basis for a unitary 
(Euclidean) space X. Prove that the scalar product of any two vectors 
x and y from X can be computed by the formula 

(x, y) = (GX„ Y e ). (7.5.1) 

G T denotes the Gram matrix of the set e lt . . e n ; X e , Y e are n- 
dimensional vector columns constituted from the coordinates of the 
vectors x and y with respect to the basis e„ . . ., e„, and the scalar 
product on the right-hand side of (7.5.1) is defined in the usual way 
(as in 7.1.4). 

7.5.12. Let e lt . ... e„ be an arbitrary basis for a linear space X, 
and let G be an arbitrary positive-definite matrix. Show that the 
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formula (7.5.1) defines a scalar product on X. Moreover, the matrix 
G T is the Gram matrix of the set e lt . . ., e n with respect to the 
derived scalar product. 

Thus, the formula (7.5.1) (just like the method of Problem 2.1.2) 
describes all possible methods of defining a scalar product on a given 
linear space X. 

7.5.13. Let (x, y)x and (x, y) 2 be two different scalar products 
on an arithmetic space. Prove that (a) there is a nondegenerate 
matrix A such that 

(*. y) i = (^4^. y) i; 

(b) it follows from (a) that 

(*. y) i = (A ' l x, y) t . 

7.5.14. Let A be an arbitrary linear operator from a unitary 
(Euclidean) space X to a unitary (Euclidean) space Y. Show that 
the product A*A is a positive-semidefinite operator on X, and the 
product .4.4* is a positive-semidefinite operator of the space Y. 
Accordingly, for any rectangular matrix A, the matrices A*A and 
AA* are positive-semidefinite. 

7.5.15. Let H be a complex positive-definite matrix. Prove that 
in the representation of the matrix H 

H = S + iK 

(where S and K are real matrices) the matrix S is positive-definite. 

7.5.16. Let H be a positive-semidefinite operator, and ( Hx , x) = 
= 0 for some vector x. Prove that (a) x belongs to the kernel N H 
of the operator H\ (b) the operator H/T h , induced on the image 
T h of the operator H, is positive-definite. 

7.5.17. Show that a positive-definite operator can be defined as a 
nondegenerate positive-semidefinite operator. 

7.5.18. Show that a Hermitian operator H is positive-semidefinite 
(positive-definite) if and only if for any positive (nonnegative) 
number e, the operator H e.E is nondegenerate. 

7.5.19. A Hermitian operator H is said to be negative-semidefinite 
( negative-definite) if for any nonzero vector x the scalar product 
(Hx, x) is nonpositive (negative). Negative-semidefinite and negative- 
definite matrices are similarly defined. 

Prove that any Hermitian operator can be represented as the sum 
of positive-semidefinite and negative-semidefinite operators. 

7.5.20*. A complex square matrix A is said to be stable if for 
any eigenvalue % for this matrix, the condition Re % < 0 is fulfilled. 

Prove that if the Lyapunov matrix equation for an n X n matrix A 

A*X + XA =C 
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(where C is a certain negative-definite matrix) has a positive-definite 
solution B , then A is a stable matrix. Hence, deduce that B is the 
unique solution of the indicated equation. 

7.5.21. What can be said about a negative-semidefinite operator H 
if its trace equals zero? 

7.5.22. Show that the determinant of a positive-definite operator 
is positive. Hence, deduce that all the principal minors of a positive- 
definite matrix are positive. 

7.5.23. Show that the element with maximum modulus in a posi¬ 
tive-definite matrix is on the principal diagonal. 

7.5.24*. Prove that a Hermitian n X n matrix H is positive- 
definite if 

i = l. •.., n. (7.5.2) 

7.5.25. Let H = S + iK be a complex positive-definite matrix. 
Prove that the real matrix 



is also positive. 

7.5.26*. Let H be a positive-definite matrix. Prove that the 
associated matrix H p is also positive definite. 

7.5.27. Prove that of all the /c-order minors of a positive-definite 
matrix H, the one with the maximum modulus is one of the princi¬ 
pal minors. 

7.5.28. Prove that the Kronecker product of positive-definite 
matrices H 1 and H 2 (perhaps, of different orders) is also a positive- 
definite matrix. 

7.5.29*. Let A and B both be n-order square matrices. The Schur 
product of the matrices A and B is a matrix C of order n X n sucb 
that for all i, j 

c u = a ijbit- 

Prove that the Schur product of positive-definite matrices H 1 aDd H 2 
is also a positive-definite matrix. 

7.5.30. Let H be a positive-definite n-order matrix. Prove that 
an n X n matrix S such that s tJ = | h l} | 2 for all i, j is also positive- 
definite. 

7.5.31. Let H and S be Hermitian operators, and let the difference 
H — S be a positive-semidefinite (positive-definite) operator. 
We will write in this case that > S (H > S). Show that for the 
relation ^ the following properties are valid: 

(a) H > S, S > T =* H > T\ 

(b) H x > S lt H 2 ^S 2 =^ a H x + $H 2 > aS x pS 2 , where a and 
P are any nonnegative numbers, 

(c) H ^ S =$ A*HA .4*5.4 for any operator A. 
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7.5.32. Let H and S be Hermitian operators, H ^ S. Prove that 
the eigenvalues of the operator S placed in descending order do not 
exceed the corresponding (also in the same order) eigenvalues of 
the operator H. 

7.5.33. A positive-definite operator H satisfies the inequality 
H ^ E. Prove that H~ x ^ E. 

7.5.34. Matrices H and S are positive-definite, H ^ S. Prove 
that 

(a) max |Am| >inax |s ( *|; 

i.i ». i 

(b) the principal minors of the matrix S do not exceed the cor¬ 
responding minors of the matrix H; and in particular, (c) det H ^ 
^ det S. 

7.5.35. A diagonal element h u of a positive-definite matrix H 
has been increased. Prove that the determinant of the obtained 
matrix H is greater than the determinant of the matrix H. 

7.5.36*. Prove the following Sylvester criterion for positive defi¬ 
niteness: for a Hermitian matrix H to be a positive-definite, it is 
necessary and sufficient that all its leading principal minors be 
positive. 

7.5.37. A leading principal k- order, minor of a nonnegative ma¬ 
trix H is equal to zero. Prove that all the leading principal minors 
with orders higher than k are equal to zero. 

7.5.38. Prove that all the principal odd-order minors of a negative- 
definite matrix H are negative, whereas all the principal even- 
order minors are positive. 

Determine for each of the following tridiagonal n-order matrices 
whether the matrix is positive-definite or positive-semidefinite. 


7.5.40. 


n-\ 1 

i n -2 



1 1 
1 1 
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1 1 
1 2 


7.5.45*. Prove that for any positive semidefinite (positive-defi¬ 
nite) operator H, there is a unique positive-semidefinite (positive- 
definite) operator K such that K 2 = H. The operator K is called 
(the principal value of) the square root of the operator H and denoted 
by H l !\ 

Find the square roots of the following matrices: 

7.5.46. II 5 -31| 7.5.47. 


I 1 1 
7.5.49. || 


—12 6 24 || 


II- 
1 1 


7.5.50*. Using the existence of a square root, prove that the 
determinant of a positive-definite n-order matrix H satisfies the 
inequality 

det H ^ h n h 22 . . . h„„. 

The equality occurs if and only if H is a diagonal matrix. 

7.5.51*. A positive definite matrix H is represented in a parti¬ 
tioned form thus: 




H f, H„ 
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where H u and H z 2 are square submatrices. Prove that 
det H det /f u -det H zz , 

and that the equality occurs if and only if H 12 = 0. 

7.5.52. Let H and S be Hermitian operators, and let S be posi- 
tive-semidefinite. Prove that if H and S commute, then H _1 and 
5 1 / 2 also commute. 

7.5.53*. Operators H and S are positive-definite and H ^ S. 
Prove that H _1 ^ S' 1 . 

7.5.54. Show that the product HS of commuting positive-semi- 
definite operators H and S is also a positive-semidefinite operator. 

7.5.55. Let H ^ S, and let T be a positive-semidefinite operator 
that commutes with H and S. Prove that HT ^ ST. 

7.5.56*. Let H and S be Hermitian operators, and let S be posi¬ 
tive-definite. Prove that the eigenvalues of the operator HS are 
real numbers and that the operator is of simple structure. 

7.5.57. The operator H is positive-semidefinite (see Problem 
7.5.56). Show that all the eigenvalues of the operator HS are non¬ 
negative. 

7.5.58. Show that the statement, converse to that in 7.5.57, is 
true: if operators H and S are Hermitian, S is positive-definite, 
and all the eigenvalues of the operator HS are nonnegative, then H 
is a positive-semidefinite operator. 

7.5.59*. Let H and S be Hermitian re-order matrices, and let S 
be positive-definite. Prove that (a) the left-hand side of the equation 
det (KS - H) = 0 (7.5.3) 

is a polynomial in \ of degree re with the higher-order coefficient 
equal to the determinant of the matrix S ; (b) the equation (7.5.3) 
has re real roots if each root is counted as many times as its multi¬ 
plicity is. 

7.5.60. Let H and S be positive-definite operators whose greatest 
eigenvalues are equal to a, and f) lt respectively. Prove that the 
greatest eigenvalue V! of the operator HS satisfies the inequality 
Vi < “iPi- 

7.5.61*. Prove that the following statements are valid: (a) the 
eigenvalues of the matrix iS^K (see Problem 7.5.15) are real and 
have absolute values less than unity; (b) det S ^ det H, and the 
equality occurs if and only if H = S; (c) det S > det K. 

7.5.62*. Let A be an operator of rank r from an re-dimensional 
space X to an m-dimensional space Y, and let e 1 , . . ., e„ be an 
orthonormal basis containing the eigenvectors of a positive-semi¬ 
definite operator .dM, the vectors e x , . . ., e T corresponding to the 
nonzero eigenvalues a*. . . ., a* (a t > 0, i = 1, 2, . . ., r). Prove 
that (a) the vectors e r+1 , . . ., e„ constitute a basis for the kernel 
N A of the operator A; (b) the vectors e lt . . ., e r constitute a basis 
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for the image T A * of the conjugate operator A*\ (c) the vectors 
Ae x , . . ., Ae r are orthogonal and form a basis for the image T A 
of the operator A; (d) the length of the vector Ae t equals a t , i = 
= 1, . . r; (e) each of the vectors Ae t is an eigenvector of the ope¬ 
rator A A* and corresponds to the eigenvalue af; (f) if we put 


then 


ft Ae t , 


t = l, r, 


A*ft = a 


7.6. Singular Values and the Polar 
Representation 

When discussing singular values, we shall mostly be interested in the various 
methods that in concrete cases facilitate compulation and estimation in prac¬ 
tical cases. The principal applications of singular values are related to metric 
problems and are discussed in Sec. 7.8 and later sections. Here, however, we 
only provide some of the inequalities that connect singular values to the eigen¬ 
values of an operator. The singular-value decomposition of an arbitrary rectan¬ 
gular matrix, and the polar representation of operators from co xx and square 
matrices, are discussed in detail. 

In all the problems, singular values a it . . ., a s are assumed to be enumerated 
in descending order 

cq > . .. > o,. 

7.6.1. Given the singular values of an operator A, find the singu¬ 
lar values of (a) the operator A*, (b) the operator aA, where a is 
an arbitrary complex number. 

7.6.2. Prove that the singular values of an operator are unaltered 
when the operator is multiplied by unitary operators. 

7.6.3. Let an operator A be defined on a space X. Show that A 
is nondegenerate if and only if all the singular values of this operator 
are nonzero. 

7.6.4. Show that the modulus of an operator’s determinant equals 
the product of its singular values. 

7.6.5. Assuming that an operator A is nondegenerate, find the 
relation between the singular values of the operators A and A -1 . 

7.6.6. Prove that the singular values of a normal operator coincide 
with the moduli of its eigenvalues. 

7.6.7. Prove that an operator A on a unitary space is unitary if 
and only if all the singular values of this operator equal unity. 

7.6.8*. Find the singular values of the differential operator on 
the space of polynomials M n with the scalar product (7.1.7). 

7.6.9*. Find the singular values of the differential operator on 
the space M 2 of polynomials if the scalar product is defined by the 
formula (7.1.2). Contrast this result with that of Problem 7.6.8. 

7.6.10*. Let A be a rectangular m X n matrix of rank r, either 
real or complex. Prove that the matrix A can be represented in the 
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form 

A = UAV, (7.6.1) 

where U and V are orthogonal (unitary) matrices of orders m and n, 
respectively; A is an m X n matrix such that ^11 =3* ^22 ^ • • • 

. . . > \ rT > 0, and all the other elements are zeroes. This repre¬ 
sentation (7.6.1) is called the singular-value decomposition of the 
matrix A. 

7.6.11. Show that the matrix A in the decomposition (7.6.1) is 
uniquely determined by the matrix A itself, viz. the numbers 
X u , . . ., k rr are the nonzero eigenvalues of the matrix (AM) 1 / 2 
(as they are of the matrix ( AA *) 1/2 ). 

7.6.12. Determine the meaning of the matrices U and V in the 
singular-value decomposition of a matrix A. 

7.6.13. Rectangular m X n matrices A and B are said to be 
unitarily equivalent if there exist such unitary matrices U and V 
that B = UAV. Prove that the relation of unitary equivalence on 
the set of m X n matrices is reflexive, symmetric and transitive. 

7.6.14. Prove that m X n matrices A and B are unitarily equi¬ 
valent if and only if they have the same singular values. 

7.6.15. Show that matrices A and B are unitarily equivalent if 
and only if the matrices A*A and B*B are similar. 

7.6.16. Given the singular-value decomposition A = UAV of 
a matrix A, find the singular-value decompositions and singular 
values of the matrices: (a) A T , (b) A*, (c) A -1 if A is a square, 
nondegenerate matrix. 

7.6.17. Show that for any m X n matrix A, there is a unitary 
m-order matrix W such that the rows of the matrix WA are orthogo¬ 
nal. Similarly, a unitary n-order matrix Z exists such that the co¬ 
lumns of the matrix AZ are orthogonal. 

7.6.18. The rows of a matrix are orthogonal. Prove that the sin¬ 
gular values of this matrix equal the lengths of its rows. 

7.6.19. Find the singular values of an m X n matrix A with 
unity rank. 

7.6.20. Let A be a partitioned matrix of the form 



where A x and A s are not necessarily square matrices. Prove that 
the nonzero singular values of the blocks A x and A 2 produce, col¬ 
lectively, all the nonzero singular values of the matrix A. The same 
statement is also valid for a partitioned matrix of the form 


7.6.21. Deduce the following corollary to the statement of 
Problem 7.6.20: if a pair of orthogonal subspaces L and Af reduce 


i4-oeio 
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an operator A, then the singular values of the operators AIL and 
AIM produce, collectively, all the singular values of the operator 4. 

7.6.22. Prove that the singular value decomposition (7.6.1) of 
a matrix A can be rewritten in the form 


A = UA r V , (7.6.2) 

where U is an m X r matrix with orthonormal columns, V is an 
r X n matrix with orthonormal rows, and A r is a diagonal matrix 
with positive diagonal elements. The representation (7.6.2) is also 
called the singular decomposition of the matrix A. 

7.6.23. Prove that for the singular values a v . . ., a„ of an 
operator A, the following version of the Courant-Fischer theorem is 
valid 

\Ax\ ' 

ah = max min -y-p-, 

L k **=0 1*1 

*61* 


a h = min 


max 


M*l 
1*1 * 


Here, as in 7.4.34, L h and L„. h+1 are arbitrary subspaces of dimen¬ 
sions k and n — k 4- 1, respectively, of the n-dimensional space X. 
In particular, the following relations hold 


a,= 


max 

**=o 


\Ax | 
1*1 * 


a n = min 
**0 


M*l 
1*1 ’ 


7.6.24. Prove that the spectral radius of an operator does not 
exceed its greatest singular value. 

7.6.25. Prove that the eigenvalue K with the minimal modulus 
and the minimal singular value a„ of an operator A satisfy the rela¬ 
tion 

\K \ >CL„. 


7.6.26. Let a x , . . ., a„ be the singular values of an n X n 
matrix A. Prove that the singular values of the associated matrix 
A p are all the possible products of p numbers from a lt . . ., a„. 

7.6.27. The eigenvalues X 2 , . . ., X„ of an n X n matrix A 

are ordered so that | ^ | > j \ > . . . > | |. Prove that the 

following Weyl inequalities are valid 

| Xi | . . . | k h | ^ a x . . . a h , 

I A* II ^h+i \ ■ \ K \ > a-hO-k+i • • • a n . 1 < n. 


They generalize 7.6.24 and 7.6.25. 
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7.6.28. Prove that the greatest and least singular values of an 
n X n matrix A satisfy the estimates 

a,>max (max |a (/ | 2 ) 1/2 , max (2 |a„| 2 ) 1/2 ), 

a„<min (min | 2 ) 1/2 • min |ai>| z ) 1/2 |. 

7.6.29*. For an operator A the equality | ^ | = a x is valid. 
Here is the eigenvalue of A with the greatest modulus. Prove 
that the operators A and A * have a common eigenvector correspond¬ 
ing to the eigenvalue Xj (T^. 

7.6.30*. Prove the statement, converse to 7,6.6, viz., if the sin¬ 
gular values of an operator A coincide with the moduli of the eigen¬ 
values, then A is a normal operator. 

7.6.31*. Let A be a rectangular m X n matrix, and let A be an 
arbitrary submatrix of the matrix A. Prove that the singular values 
of the matrix A do not exceed the corresponding singular values of A. 

7.6.32. Let A be an arbitrary square submatrix of a normal 
matrix A. Prove that the spectral radius of A does not exceed the 
spectral radius of A. 

7.6.33. Prove that the singular values a h , p ft , y k of operators A, 
B and A + B satisfy the inequalities: 

Yfc ^ ®i + Pft» Yfc ^ “ft + Pi. 

Yh > —«i + P>i, Yh > “ft — Pi. 1 < * < n. 

7.6.34*. Operators A and B are defined on an n-dimensional 
space X. Prove that the singular values a h , p h , 6 h of the operators 
A, B and AB satisfy the relations: 

6ft ^ «iPft. 6ft ^ «ftPi. 

6h > “nPn, 6 h > aftP n , 1 < k < n. 

7.6.35. Let A and B be positive-definite operators. Prove that 
the eigenvalues of the operator AB are equal to the squares of the 
singular values of the operator A I /*5 1 /*. 

7.6.36. Given the singular values a lt . . ., a„ and p lt . . ., p m 
of matrices A and B of orders n and m, respectively. Find the singu¬ 
lar values of the Kronecker product A X B. 

Find the singular values of the following matrices: 

7.6.37. II2 o 0|| 7.6.38. ||o 2 o 

01 0 . 00—3 

II0 0 —21| 111 0 0 
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7.6.39. 

1 4 

—2 2 

7.6.40. 

4-2 4 || 


4 

4 —1 


2-1 2 . 


1—2 

4 2 


—4 2 -4 || 

7.6.41. 

i 4 

—3 i 0 

7.6.42. 

0 0 2 -1 || 


—3i 

4 0 


0 0 2 1 


1 o 

0 -3 


1/2 -/2 0 0 r 





— 1/2 1/2 0 0 || 

7.6.43. 

0 

1/3 0 

0 II 7.6.44. || 1 1 1 1 || 


1/3 

0 2 

0 

;;;; . 


0 

2 0 

1/3 * 

II. “Ill 


0 

0 1/3 

0 


7.6.45. 

1 

1 1 

1 II 7.6.46*. |l 2-14 -2 || 


1 

i —1 - 

-l 

2 14 2 


1 - 

-1 1 - 

-1 ' 

-4 22-1- 


1 - 

-t -1 

t 

-4-22 1 


7.6.47. What becomes of the polar representation of a matrix 
of order n when n = 1? 

7.6.48. Show that in a polar representation A = HU of an opera¬ 
tor A, the positive-semidefinite operator II is uniquely determined. 

7.6.49*. Let A = HU be an arbitrary polar representation of an 
operator A. Show that the operator U transforms the orthonormal 
basis, containing the eigenvectors of the operator A*A, into a simi¬ 
lar basis for the operator AA*. 

7.6.50. Show that for whatever polar representation A = HU 
of an operator A, the unitary operator U transforms the subspace 
T A * into T A> and the subspace N A into N A *. 

7.6.51*. Let A = HU be an arbitrary polar representation of an 
operator A. Prove that effect of the unitary operator U on the sub¬ 
space T A , is uniquely determined by the operator A. 

7.6.52. Prove that a nondegenerate operator possesses a unique 
polar representation. 

7.6.53. Prove that any operator A on a unitary (Euclidean) 
space can be represented in the form 

A = U X H X , 

•where U x is a unitary (orthogonal), and H x a positive-semidefinite. 
operator. Show that the operator H x is, in this representation, 
•uniquely determined. 

7.6.54*. Prove that an operator A is normal if and only if the 
operators H and U in its polar representation A = HU are commut¬ 
ing. 
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7.6.55. Let A be a nondegenerate normal operator on a unitary 

space, and let its eigenvalues A. 1 , . . ^ be given in trigonometric 

form 

K = Pi (cos <Pi + i sin q^), .... K = p„ (cos q>„ + i sin <p„). 
Prove that the operators H and U in a polar representation of the 
operator A have the eigenvalues p lf . . p„ and cos q> x + 
+ i sin q> 1( . . cos q>„ + i sin q> n , respectively. 

7.6.56. An operator S is positive-semidefinite. Find its polar 
representation. 

7.6.57. Find a polar representation of the differential operator 
on the space Af„ of polynomials with the scalar product (7.1.7). 

7.6.58. Given a polar representation A = HU of a matrix A, 
find a polar representation of the associated matrix A p . 

7.6.59. Given square matrices A and B, perhaps, of different 
orders and letting A = HU and B = KV be their polar representa¬ 
tions, find a polar representation of the Kronecker product A X 5. 

Find polar representations of the following matrices: 

7.6.60. II -1 -7 || 7.6.61. || 0 3-1 || 

|| 1 7 II* 0 4 2 . 

II -5i 0 0 || 

7.6.62*. || 2-14 -2 || 

2 14 2 
-4 22 —1 * 

II -4-2 2 1 || 

7.6.63*. Using the polar representation, prove the converse of 
7.5.56, viz., that if an n X n matrix A, whose eigenvalues ... 
. . ., are real numbers, is of simple structure, then A can be 
represented in the form A = HS, where H and S are Hermitian 
operators and S is positive-definite. If the matrix A is real, then the 
factors H and S can be chosen to be real. 

7.6.64*. Prove that the sum of the singular values a lt . . ., a„ 
of an n X n matrix A satisfies the representations 

+ a n = inax |tr (AkF)| = max Re tr {AW), 
w w 

where W ranges over/he whole set of unitary n-order matrices. 

7.7. Hermitian Decomposition 

The purpose of this section is to illustrate that, despite its simplicity, Her¬ 
mitian decomposition is a useful instrument. In many cases a problem, piosed in 
terms of arbitrary operators, can be transferred using the Hermitian decompo¬ 
sition to an analogous task posed in Hermitian operators, the solution of which 
proves to be much simpler to obtain. At the end of the section we demonstrate 
an analogue of the Hermitian decomposition of operators on a Euclidean apace 
(see Problem 7.7.23). 
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7.7.1. What does the Hermitian decomposition of an n-order 
matrix, when n = 1, turn into? 

7.7.2. What can be said about a linear operator A if (Ax, x) = 0 
for any vector x? 

7.7.3. What can be said about linear operators A and B if for 
any vector x: 

(a) (Ax, x) = (Bx, x)? 

(b) (Ax, x) = (x, Bx)f 

7.7.4. Prove the converse to 7.4.22, viz., that if the scalar prod¬ 
uct (Ax, x) is a real number for any operator A, then for any opera¬ 
tor x, A is a Hermitian operator. 

7.7.5. Show that in the definition of a positive-definite operator 
on a unitary space the requirement that it should be Hermitian is 
extra. 

7.7.6. Let H and S be Hermitian operators. Show that the scalar 
product (Hx, Sx) is real for any vector x if and only if H and S 
are commuting. 

7.7.7. What can be said about an n X n matrix A if it is orthogo¬ 
nal to any Hermitian matrix with the scalar product defined as in 
(7.1.5)? 

7.7.8. Let the trace of the product AH of an n X n matrix A 
and any Hermitian matrix H be a real number. Prove that the 
matrix A is Hermitian. 

7.7.9. Let A = H x + iH 2 be the Hermitian decomposition of an 
operator A. Find the Hermitian decomposition of the conjugate 
operator A*. 

7.7.10. Prove that an operator A is normal if and only if the 
operators H x and H 2 in its Hermitian decomposition are commuting. 

7.7.11. Show that the eigenvalues of the operators H x and H 2 
from the Hermitian decomposition of a normal operator A coincide 
with the real and the imaginary parts, respectively, of the eigen¬ 
values of the operator A. 

7.7.12. Show that any orthonormal basis, containing the eigen¬ 
vectors of a normal operator A is also a basis made up of the eigen¬ 
vectors of the operators H x and H 2 of its Hermitian decomposition. 

7.7.13. Let A and B be commuting normal operators, and let A = 
= H x + iH 2 , B = S x + iS 2 be their Hermitian decompositions. 
Prove that all the opefators H x , H 2 , S x , S 2 are commuting. 

7.7.14. Let A be an operator on an n-dimensional space with the 
Hermitian decomposition A = H x -\- iH 2 . Prove that the set of 
values for the ratio 

(Ax, T) 

(*. *) 

(where x is an arbitrary nonzero vector) is bounded by a rectangle 
in the complex plane with vertices (o lf p x ), (a lt {£,), (a„, {£), 
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(a„, (Jj), otj, a n and p lt |J n being the greatest and least of the eigen¬ 
values of the matrices H l and H 2 , respectively. 

7.7.15. Deduce the following Bendixson theorem, from 7.7.14: 
the real (imaginary) parts of the eigenvalues of an operator 4 are 
confined between the greatest and least eigenvalues of the operator 
H x (H 2 ) of its Hermitian decomposition. 

7.7.16. The operator H x from the Hermitian decomposition of an 
operator .4 is positive-definite. Prove that the operator .4 is nonde¬ 
generate. 

7.7.17*. The matrix H x in the Hermitian decomposition of a 
matrix A is negative-definite. Prove that (a) the matrix A is stable 
(see 7.5.20); (b) the product of the matrix 4 by any positive-definite 
matrix H is also a stable matrix. 

7.7.18*. The diagonal elements a,, of a complex tridiagonal 
matrix 4 are real numbers and the off-diagonal elements satisfy 
the inequalities a t , {+1 aj +1> f C 0, i = 1, 2, . . ., n — 1. Prove 
that the eigenvalues of the matrix 4 are bounded by the strip in the 
complex plane: 

min a M <Re z<maxa <( . 

7.7.19*. A square real matrix 4 is called a tournament matrix 
ifjall the diagonal elements a tt are zeroes and the off-diagonal ele¬ 
ments satisfy the condition a lf + = 1 for all i, j (i j). Prove 

that the eigenvalues of a tournament matrix 4, considered in the 
field of complex numbers, lie in the strip of the complex plane 

—<Re —1), 

where n is the order of 4. 

7.7.20*. Prove that in the context of Problem 7.7.16 

I det 4 | > det H x . 

When does the equality occur in this relation? 

7.7.21*. By means of the Schur theorem, prove that the follow¬ 
ing relationship between the eigenvalues % x , . . ., and a x , ... 
. . ., oc„ of the operators 4 and ff x , respectively, is true (see Prob¬ 
lem 7.7.16) 

Re ^ Re \ 2 • • • Re ^ a i a t • • • 

The equality occurs if and only if Re X t = a t , l = 1, . . n, with 
the appropriate ordering of the eigenvalues. 

7.7.22. Show that the greatest singular value a x of an operator 4 
satisfies the inequality 

«i < P (#i) + P (#.)• 
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Here p (H x ) and p (H t ) are the spectral radii of the operators H x 
and H 2 of the Hermitian decomposition. 

7.7.23. Show that any linear operator A on a Euclidean space can 
be uniquely represented in the form 

A = S + K, 

where S is a symmetric, and K a skew-symmetric operator 

7.7.24. Prove that the space R nxn (see 7.1.17) is the orthogonal 
sum of the subspace of symmetric matrices and the subspace of skew- 
symmetric matrices. 

7.7.25. What can be said about a linear operator ^4 on a Euclidean 
space if {Ax, x) = 0 for any vector x ? Contrast this with the re¬ 
sult of 7.7.2. 


7.8. Pseudosolutions 

and Pseudoinverse Operators 

The first half of the section is devoted to the properties of pseudosolutions 
and a normal pseudosolution of the equation Ax = b, where A is generally an 
operator from (0 XY , and 6 is a fixed vector from the space Y. Several methods of 
evaluating pseudosolutions are demonstrated, using predetermined orthonormal 
bases that were obtained from the eigenvectors of the operators A* A or A A*. 
Remember, by the way, that these bases and f l% . . ., / m are called 

the singular bases of an operator A (and of A*) if the vectors e lt . . ., e r and 
A, . . ., f r , corresponding to nonzero eigenvalues of, . . ., of, are connected by 
tne relations 



Singular bases play a principal role in proving various properties about the 
pseudoinverse operator to which the second part of the section is devoted. We 
treat this subject more extensively than is required for immediate academic 
purposes, taking into account the scarcity of the material on the pseudoinverse 
operator in general text-books on linear algebra. In specialized literature inter¬ 
pretations of this notion can be found that seem totally different to each other 
at first glance, but which are certainly equivalent. We present a number of such 
definitions to prove their equivalence. We demonstrate also that a number of 
classes of operators on a unitary space (normal, Hermitian, positive-semidefinite) 
is closed under the operation of pseudoinverse determination. 

7.8.1. Let b T be a projection of a vector b onto the image T A 
of an operator A. Prove that any pseudosolution of the equation 
Ax = b is a pre-image of the vector b T . 

7.8.2. Show that the set of all pseudosolutions of the equation 
Ax = b is a plane whose directional subspace is the kernel N A of 
the operator A. This plane is a subspace if and only if b belongs 
to the kernel N A • of the conjugate operator A*. 

7.8.3. Show that a normal pseudosolution of the equation Ax = 
= b can be specified as a pseudosolution of this equation, orthogonal 
to the kernel of the operator A , or in other words, as a pseudosolution 
belonging to the image of the conjugate operator A*. 
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7.8.4. Let A be a differential operator on the space M„ of poly¬ 
nomials with the scalar product defined as in (7.1.7), and let g ( t) 
be a given polynomial from M n . Find all the pseudosolutions and 
a normal pseudosolution of the equation Af = g. 

7.8.5. How are pseudosolutions and normal pseudosolutions of 
the equation Ax = b and the equations (a) aAx = b , (b) Ax = ab, 
(c) aAx = ab related where a is a nonzero number? 

7.8.6. How are normal pseudosolutions of the equation Ax = b 
and the equations (a) UAx = Ub, (b) AVx = b related? Here U 
and V are unitary operators. 

7.8.7. Let A be a normal operator, and let an orthonormal basis, 

e lt . . e„, containing the eigenvectors of this operator, be given. 

How are the pseudosolutions and a normal pseudosolution of the 
equation Ax = b found? 

7.8.8*. Let A be an operator of rank r from an n-dimensional 
space X into an m-dimensional space Y. Given an orthonormal basis 
e lt . . ., e n , containing the eigenvectors of the operator A* A and 
the corresponding eigenvalues af, . . a« (ctj > 0, i = 1 , . . r), 
prove that (a) the pscudosolutions of the equation Ax = b are de¬ 
scribed by the formula 


where 


x = Pl«l + • • • + Pr*r + Yr+l^r+1 + • • • + Yn*n. 


O (b. Aei) 
p< ~ [.Ae t , Aen 


(A*b, e t ) 
- 


i = l, 


r, 


and y r+1 , . . ., y„ are arbitrary numbers; (b) the normal pseudosolu¬ 
tion is the vector 


x o = Pi«i + • • . + Pr«r- 


7.8.9. Given an orthonormal basis f x , . . ., / m , containing the 
eigenvectors of the operator AA* (while a t > 0, i = 1, . . ., r), 
prove that the normal pseudosolution of the equation Ax = b can 
be found by the formula 


x 0 = hA*fi + ... + IrA'fr, 

where 


Find the normal pseudosolutions of the following systems of linear 
equations, assuming that the scalar products on the corresponding 
arithmetic spaces are defined by (7.1.4). 

7.8.10. 279x x + 362x 2 - 408x 3 = 0, 

515x! - 187x 2 + 734x, = 0 
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7.8.11*. 

27x,-55x a =l, 

— 13x 1 + 27x a = 1, 

— 14x, + 28x a = 1. 


7.8.12. 

x i + x 2 + x s + x i = 2, 

7.8.13. Xj-}-x 2 — 2, 


x l + x 2 + x 2 + x i = 3, 

x, — x a = 0, 


x i + x 2 -\-x t + x i = A. 

2x 1 + x a = 2. 

7.8.14. 

—— 2x 2 — 1 » 

2x, -|- 4x a = 0, 
x, + 2x a = 0, 

3x, + 6x a = 0. 


7.8.15. 

2x, — x a =1, 

— x,-i-x a 4-x, = 0, 
x a + 2x 3 = 1. 



7.8.16. 2x,-x a =1, 

-a: 1 + (l + e)x a + a:, = 0, (e=^0). 


x a + 2*, — 1. 

7.8.17. 2x,-x a =1, 

-x l - r x 2 + x s =0, 

x a + (2 + e)x, = l, (e ^ 0). 

7.8.18*. 5X( — 3x t =2, 

4x a “H 2x a -1- 2x 5 = 3, 

2x a + 2x s =0, 

— 3x t -j- x 4 = — 2, 

2x a ~r 2x s = 3. 

7.8.19. Find pseudoinverse operator of the null operator from X 
into Y. 

7.8.20. Prove that the pseudoinverse operator of a nondegenerate 
operator coincides with its inverse. 

7.8.21. Find the pseudoinverse operator of the differential opera¬ 
tor on the space M n of polynomials with the scalar product defined 
as in (7.1.7). Compare the obtained operator with the conjugate 
(see 7.1.34). 

7.8.22. Prove that for any operator A and a nonzero number a 

(aA)+=±A+. 
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7.8.23. Prove that for any unitary operators U and V: 

(a) (UA) + = A + U* t 

(b) (AVy = V*A + . 

7.8.24. Show that the image and kernel of the pseudoinverse 
operator A* coincide with the image and kernel, respectively, of 
the conjugate operator A*. 

7.8.25. Consider an operator A as an operator from T A * into T A , 
and the pseudoinverse operator A + as an operator from T A into T A *. 
Show that the operators A and A + are inverse to each other on this 
pair of subspaces. This means that for any vector x from T A * and 
any vector y from T A , 

A*Ax = x, AA*y = y. 


7.8.26. Show that stating the properties of the pseudoinverse 
operator listed in 7.8.24 and 7.8.25, together with that of linearity, 
is equivalent to the definition of the pseudoinverse operator. 

7.8.27. Let e lt . . ., e n and / x , . . ., f m be singular bases for an 
operator A. Find the matrix of the pseudoinverse operator /1 + with 
respect to this pair of bases. 

7.8.28. Show that singular bases for an operator A are also singu¬ 
lar for the pseudoinverse operator /1 + . Meanwhile, the nonzero sin¬ 
gular values of the operators are reciprocal. 

7.8.29. Show that (4 + )+ = A. 

7.8.30. Show that (4*)+ = (A*)*. 

7.8.31. Show that the pseudoinverse operator of a Hermitian 
operator is also Hermitian. 

7.8.32. Show that the pseudoinverse operator A + of a normal 
operator A is also normal. Find the relationship between the eigen¬ 
values of the operators A and A + . 

7.8.33. Prove that a normal operator A satisfies for any k the 
relation (/t h ) + = L4 + ) ft . 

7.8.34. Prove that the pseudoinverse operator of a positive- 
semidefinite operator is also positive-semidefinite. 

7.8.35. Let A = HU, and let A = be polar representations 
of an operator A. Find polar representations of the operator A*. 

7.8.36. Prove that for an operator A to coincide with its pseudoin¬ 
verse operator, it is necessary and sufficient that (a) the image T A 
and kernel N A should be orthogonal; (b) the induced operator AIT A 
should satisfy the equality 

(A/Ta)- 1 = A/T a . 

In particular, these conditions are fulfilled for an operator of ortho¬ 
gonal projection. 
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7.8.37*. Let operators A and B satisfy the relations A*B = 0 
and BA* = 0. Prove that (A + B)+ = A* + B*. 

7.8.38*. Operators A and B are such that T A = T fl *. Prove 
that {BA)* = A+B+. 

7.8.39. Prove the equality 

AA + A = A. 

7.8.40. Show that the geometric meaning of the equation 

AX A = A (7.8.1) 

in a linear operator X is that the operators A and X are inverse to 
one another on the pair of subspaces XT A and T A in the sense de¬ 
fined in 7.8.25. 

7.8.41. Prove that a pseudoinverse operator A + can be defined 
as a linear operator satisfying equation (7.8.1) and having the same 
image and kernel as the conjugate operator A*. 

7.8.42*. Prove that each of the definitions indicated below is 
equivalent to the definition of a pseudoinverse operator: 

(a) an operator X satisfying equation (7.8.1) and such that 

X = A*B = CA* 

for certain linear operators B and C\ (b) an operator X satisfying 
equation (7.8.1) and such that 

X = A*DA* 

for a certain linear operator D; (c) an operator X satisfying the 
equation A*AX = A* and such that 
X = A*AF 

for a certain linear operator F. 

7.8.43. Prove that the rank of the operator (i4 + ) 2 equals the rank 
of the operator A*. 

7.8.44. Given an operator A from a space X to a space Y, prove 
that the operator A*A is Hermitian and projects the space X ortho¬ 
gonally onto the subspace T A *. 

7.8.45. Describe the geometric meaning of the requirements for 
an operator X to be specified by the system of equations 

AXA = A, 

{XA)* = XA. (7.8.2) 

7.8.46. Prove the equality A+AA + = A*. 

7.8A7. An operator X satisfies system (7.8.2). What does a new 
requirement for this operator specified by the equation 
XAX = X 


mean? 
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7.8.48. Prove that the operator A (see Problem 7.8.44) stipulates 
that the operator A A* is Hermitian and projects the space Y ortho¬ 
gonally onto the subspace T A . 

7.8.49. Prove that the conditions 

AXA = A, XAX = X, 

(XA)* = XA, (AX)* = AX 

determine the pseudoinverse operator uniquely. These conditions 
are called the Penrose equations after a British mathematician who 
was one of the first to introduce the notion of a pseudoinverse opera¬ 
tor (a pseudoinverse matrix, actually). 


7.9. Quadratic Forms 

In this section we shall focus our attention mostly on: 

The reduction of a quadratic form to its canonical form by an orthogonal 
transformation of the unknowns. 

The law of inertia, relation of congruence, and the use of principal minors 
for finding the indices of inertia. 

Simultaneous reduction of a pair of quadratic forms. 

The Lagrange method of the reduction to canonical form, considered only 
with regard to positive-definite forms. Hence, the possibility that a positive- 
definite matrix may be reduced into the product of two triangular matrices, 
each the transpose of the other. Such a reduction forms the basis for one of the 
most efficient techniques for the solution of systems of linear equations with 
matrices of this class. We have paid particular attention to this method and 
its computational aspects. 

Note that all the matrices considered in the present section are assumed to 
be real. 

. or each of the quadratic forms below, find an orthogonal trans¬ 
formation of the unknowns that makes the form canonical, and state 
the canonical form obtained. 

7.9.1. 2x\ + 5x| -f 2x£ — 4x x x 2 — 2x x x 3 -f 4x 2 x 3 . 

7.9.2. — 3x£ + 4x 1 x 2 -f lOxjXa — 

7.9.3. — x\ + x\ — 5 i 3 + 6 x ^3 + 4 x 2 X 3 . 

7.9.4. 2x x x 4 -f 6 x 2 X 3 . 

7.9.5. x\ + 4x1 + x\ + 4xJ + 4x x x 2 + 2xjX 3 + 4x x x 4 -f 4 xjX 3 - 1 - 

+ 8x2X4 + 4x3X4. 

7.9.6*. Suppose a quadratic form F (x lt . . ., x„) is reduced by 
some (even degenerate) transformation to the form 

F=yJ+ ... +yl—yl+\ — • • • —yl+i- 

Prove that the positive index of inertia for the form F does not ex¬ 
ceed k, and that the negative index of inertia does not exceed l. 

7.9.7. Prove that for separating a quadratic form into the prod¬ 
uct of two linear forms, it is necessary and sufficient that the rank 
of the form should not exceed two, and that the signature should 
be equal to zero if the rank equals two. 
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7.9.8. Show that the rank and signature of a quadratic form are 
either both odd or both evon. 

7.9.9. Real n X n matrices A and B are said to be congruent 
if there exists a nondegenerate matrix P such that B = P T AP. 
Show that the congruence relation on the set of square matrices of 
a given order is reflexive, symmetric and transitive. 

7.9.10. Prove that a matrix A is congruent to a diagonal matrix 
if and only if it is symmetric. 

7.9.11. Prove that symmetric matrices A and B are congruent if 
and only if they have the same number of positive and negative 
eigenvalues. 

7.9.12*. Using the properties of the eigenvalues and principal 
submatrices of symmetric matrices (see 7.4.35), prove that if a 
matrix A is the matrix of a quadratic form F in n unknowns and if 
all the leading principal minors of the matrix A are different from 
zero, then the positive (negative) index of inertia of the form F 
equals the number of repetitions (changes) of sign in the number 
sequence 

<1, D lt D t , . . ., D n , 

where D ( is the leading principal minor of order i. This rule for 
finding the indices of inertia was introduced by Jacobi. 

7.9.13*. The minor D k , k <. n (see Problem 7.9.12) is zero, but 
the minors Dft-i and D fc+1 are nonzero. Prove that D k . 1 D h+1 < 0. 

7.9.14*. Assume that the determinant D n =£ 0 in the sequence 
1, D lt . . ., D n but if k < n, then the minor D h may be zero. In 
which case, assume, additionally, that both and D h+1 are non¬ 
zero. By giving arbitrary signs to the zero values of D h , show that 
the Jacobi rule for finding the indices of inertia is still valid for 
this case. This modification to the Jacobi rule is due to Gundelfinger. 

7.9.15. Deduce statements 7.4.44 and 7.4.45 from 7.9.12 and 
7.9.14. 

Compute the indices of inertia for the following quadratic forms. 

7.9.16. XiX 2 + x*x 3 + x 3 x 4 . 

7.9.17. XjXj + 2xiX 3 + 3x x x 4 + x^x, + 2xjX 4 + XjX 4 . 

7.9.18. xj + 2x\ + 3x| + 4x| + 2xiX 2 4- 2x x x 3 + 2x 3 x 4 + 

+ 4 x ^3 + 4 x 3 X 4 + 6 x 3 x 4 . 

7.9.19. Let the coefficient a u in a quadratic form F (x lt . . ., x„) 
be greater than zero. What will be the result of the following trans¬ 
formation of the unknowns 

I/l = y=== (filial + • ■ • + ain*n). 
y l = x l , 1 = 2, ..., n? 

7.9.20*. Prove that a positive-definite quadratic form can be 
reduced to the normal one by a triangular transformation of the 
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unknowns, i.e. by a transformation of the form 
y i = s li x i + s i2 x 2 +...+s in x n , 

1/2= S 2 2*2+..-+S2r,*r,> (7-9.1) 


J/n = s nn*n’ 

where s u , s 22) . . s nn are different from zero. 

Reduce the following quadratic forms to normal ones by a triangu¬ 
lar transformation: 

7.9.21. x] + 2xl + 3x1 + 2 x x x 2 + 2x 2 x 3 + 4 x 2 X 3 . 

7.9.22. x'j + 2x1 + 2x1 + 2x1*2 + 2x2X 3 . 

7.9.23. xjf + 4x1 + H *3 + 24xi — 2 xjX 8 — 4x x x 4 -f 4 x ^3 + 

+ 16 x 3 X 4 . 

7.9.24. Prove that for any positive-definite matrix A , there is 
a so-called triangular decomposition, i.e. 

A = S^, (7.9.2) 

where S is an upper triangular matrix. 

7.9.25. Show that the diagonal elements of the matrix S in the 
triangular decomposition (7.9.2) and the leading principal minors 
D j of the matrix A are connected by the relations 

sh = » t = l» •••* n; D 0 = 1. 

The same is true for the diagonal elements of formulae (7.9.1). 

7.9.26. Prove that a triangular decomposition (7.9.2) of a positive- 
definite matrix A, where all the diagonal elements s tl are positive, 
is unique. 

7.9.27. Show that the elements of the matrix S in decomposition 
(7.9.2) can be calculated consecutively in the order s u , s 12 , . . ., s ln , 
$ 22 , $ 23 , . • ., $nn hy the formulae 

$11 = 1^011’ ^1/ = “5^”* / = 2, •••> n > 

s„ = y (*>!)• (7.9.3) 

a U~ 2 s *l s *i 

^- <>'>* 

Using formulae (7.9.3), find triangular decompositions of the 
following matrices: 

7.9.28. II 4 2 - 21 | 7.9.29. || 9 -3 0|| 

25 1 * “ 3 5 “ 4 i- 

11-2 1 31| II 0 -4 51| 
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7.9.30. Ill 2 3 4 

2 5 8 11 

3 8 14 20 * 

|| 4 11 20 30 

7.9.31. A positive-definite matrix A is of the band structure, 
i.e. a i} = 0 when | i — / | > d > 0. Using formulae (7.9.3), show 
that s tJ = 0 when / — i > d. 

7.9.32. Find the triangular decomposition of the following tri¬ 
diagonal matrix of order n 

1 l/2 

l/2 3 l/2 

A _ 3 1/2 

3 l/2 
1/2 3 

7.9.33. Show that if a matrix S represents the triangular decom¬ 
position of a matrix A, then its principal submatrix S k represents 
the triangular decomposition of the submatrix A k of the matrix A. 

7.9.34. Using the result of Problem 7.9.30, find the triangular 
decomposition of the matrix 

1 2 3 4 5|| 

2 5 8 11 14 

3 8 14 20 261|. 

4 11 20 30 40 

5 14 26 40 551| 

7.9.35. Prove that for the olements of the matrix S of the triangu¬ 
lar decomposition in (7.9.2), the following inequality holds: 

max | | < max V a u • 

t. i i 


Hence, deduce that if for the matrix A, max | a ti \ — 1, then 
max | s l} | ^ 1. 

In these circumstances when the triangular decomposition of 
a positive-definite matrix is being computed, growth of elements 
(in the indicated sense) will not occur. 

7.9.36. Find the number of multiplication, division, and square 
root operations that are needed to obtain the triangular decomposi¬ 
tion matrix using formulae (7.9.3). 

7.9.37. Given the triangular decomposition of a positive-definite 
matrix A, find a method to solve the system of linear equations 
Ax = b. 
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7.9.38. Find the total number of multiplications and divisions 
necessary to solve the system of linear equations Ax = b (where A 
is a positive-definite matrix) when a triangular decomposition using 
formulae (7.9.3) followed by an application of triangular matrices 
to the subsequent systems (see 7.9.37) is used. Compare this with 
the number of multiplication and division operations necessary for 
Gaussian elimination. 

The method indicated for the solution of a system of linear equa¬ 
tions with a positive-definite matrix is called the square root method. 

7.9.39. Prove that a positive-definite matrix A can be also repre¬ 
sented as the product 

A = S^J, (7.9.4) 

where S x is an upper triangular matrix. 

7.9.40. Let A be a positive-definite matrix, and A the matrix 
obtained when the elements of A are reflected through the centre of 
A, A = S T S is then the triangular decomposition of the matrix A. 
Prove that this representation (7.9.4) of A can be obtained by reflect¬ 
ing each of the matrices S T and S through their centres. 

7.9.41. Prove that two quadratic forms F and G both in the same 
unknowns can be reduced to canonical form by the same nondegener¬ 
ate linear transformation if at least one of the forms F and G is posi¬ 
tive-definite. 

7.9.42. Given quadratic forms F and G both in the same un¬ 
knowns, the form G being nondegenerate. Prove that if a nondegener¬ 
ate linear transformation exists that can reduce both F and G to 
canonical form: 

G = ^iVi+ •+p n y». 

then the set of ratios 

X, Xn_ 

Hi ’ Ht ’ ‘ " ’ 

is the same for any such transformation. These ratios are the roots 
of the so-called z-equation of the pair of forms F and G, i.e. | A —zB | = 
= 0, where A and B are the matrices for F and G, respectively. 

7.9.43. Quadratic forms F and G are positive-definite. Consider 
two nondegenerate linear transformations, the first reducing F to 
the canonical form + . . . + ‘k n y l n and G to a normal form, and 
the other reducing F to a normal form and G to the canonical form 
PjZ? + . . . + p n z\. How are the coefficients A, lt . . ., A,„ and 
Pi, . . ., p„ related? 

7.9.44. Prove that the forms F and G can both be reduced to ca¬ 
nonical form by the same nondegenerate linear transformation if 
the matrices of these forms are commuting. 


>-0819 
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For each of the following pairs of quadratic forms, find a nondege¬ 
nerate linear transformation that reduces both to canonical form 
and state the obtained forms: 


7.9.45. F= x\ + 2x\ + 3xl + 2xix 2 —2x l x t , 

G = 2x* -f- 8 x| - 4 - 3x| 8x 4 x 2 -|- 2xjX 3 -|- 4x 2 x 3 . 

7.9.46. F = x\- f 5 x* + xJ-l2x 1 x 2 4- 6 x^- 1 - 2 x^ 3 , 

G = x\ — 2xj| + x\+4x t x 2 — 10x,Xj + 4x 2 x 3 . 

7.9.47. F=— xj— 5x’ —14xJ-f4x 1 x 2 -f6x,x 3 — 8x 2 x 3 , 

G = — xj — 14x£ — 4xJ + 8x,x 2 — 2x,x 3 + 4x 2 x 3 . 

7.9.48. F = xJ-f3x5+ x\— xj—2xjx 2 —4x2X 3 f2x 3 x 4 , 

G =■ x\ + 2x5 -r 2x5 + 2xJ — 2x,x 2 — 2 x ^3 — 2x 3 x 4 . 

7.9.49. F— xj+ x^-f x\+ xJ + 2x,x 2 -)-4x,x s 

4- 2x,x 4 + 2 x 2 X 3 + 4x 2 x 4 + 2x s x 4 , 


G 2xJ -f 2x5 -r 2x* + 2xJ—2x,x 2 + 2x,x s 

— 2x,x 4 — 2x 2X 3 + 2xgX 4 — 2x3X4. 

7.9.50. Assume that F and G are quadratic forms both in the 
same unknowns X|, .... x n , and G is positive-definite, and enumera¬ 
te the roots of the z-equation in descending order z 2 > z 2 > . . . 
. . . ^sz„. Prove that for the biggest root z x and smallest root z n , 
the following representations are true 


z, = max 


F (x lt ..., x B ) 
G(xi .x n ) * 


min 

ij+... +*^*.0 


F(x x , ..., x B ) 
.x n ) * 


7.9.51. Formulate and prove the analogue of the Courant-Fischer 
theorem for the pair of the forms in the preceding problem. 
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8.0. Terminology and General Notes 

A set X is called a metric space if to each pair of its elements x 
and y, there is assigned a nonnegative number p (x, y) called the 
distance between x and y, and the following conditions are fulfilled: 

(i) p (x, y) = 0 if and only if x = y; 

(ii) p (x, y) = p (y, x); 

(iii) P (*. z) < P (*, y) + p (y, Z). 

If il/j is a subset of a metric space X, then the set of all elements 
x 6 X, not belonging to M x , is called the complement of the set M x . 
If M u M 2 , ... are the subsets of X, then the set of all elements, 
each of which belongs to at least one of the sets M lt M 2 , . . ., is 
called the union of M x , M 2 , .... The set of all elements, which 
are elements of each of the sets M x , M 2 , . . ., is called the inter¬ 
section of M x , M 2 , .... 

The set of all elements x from X fulfilling the condition 
p (a, x) < r 

is called i sphere S (a, r). The element a is called the centre of the 
sphere, and the positive number r the radius of the sphere. 

The neighbourhood of an element x is any sphere, centre x. A set M 
in a metric space X is said to be open if it contains for every ele¬ 
ment x some neighbourhood of the element. 

An element x 6 X is called a boundary point of a set M if any 
neighbourhood of this element contains at least one element from M 
which does not coincide with x. The set obtained from M by adding 
all its boundary points, is called the closure of the set M and denot¬ 
ed by M. A set M is closed if M = M. 

The set S (a, r) of all elements x from X fulfilling the condition 

p (x, a) < r 

is called a closed sphere, centre a and radius r. 

An element x 0 from a metric space X is called the limit of a sequence 
{x„} of elements x lt x 2 , from X if p (x 0 , x„) -»-0 as 

n oo^ We write this as 


is* 
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or 

lim x n - x 0 . 

A sequence {x„} which has a limit (x 0 ) is said to be convergent. 

A sequence {x„} of elements from a metric space is said to be 
fundamental if for any number e > 0 there is another number N (e) 
such that p (x„, x m ) < e, when n, N (e). 

If any fundamental sequence in a metric space X converges to 
a limit, then the space is said to be complete. 

A real or complex linear space X is called a linear normed space 
if each vector x £ X has an associated real number || x || called the 
norm of the vector x, and which fulfils the following conditions: 

(i) || x || ^ 0, moreover || x || = 0 only if x = 0; 

(ii) || x -f y || < || x || -f || y || (the triangle inequality); (8.0.1) 

(iii) || he || = | X | || x ||. 

A normed space can be treated as a metric space if we put 
P (*, y) = II x — y ||. 

The convergence of a sequence with respect to the distance thus 
defined is called the convergence with respect to the norm. 

A set M in a linear normed space X is said to be bounded if there 
is a positive number C such that || x || ^ C for all x from M. 

The unit sphere of a normed space X is the set of all vectors x 
for which || x || < 1 (|| x || = 1). 

A set M in a normed space is said to be convex if, in addition to 
any two of its vectors x and y, it also contains the whole segment 
Xx + (1 - X) y, 0 < X < 1. 

Any finite-dimensional linear normed space X is a complete metric 
space. Moreover, describing a set M from X as bounded is equivalent 
to describing the coordinates of all vectors x from M with respect 
to any basis for the space X as bounded. Similarly, the convergence 
of a sequence {x ft } to a vector x 0 is equivalent to the convergence of 
the coordinates of the vectors x h to the corresponding coordinates 
of the vector x 0 with respect to any basis for the space X. 

An example of a normed space is the n-dimensional arithmetic 
space in which the norm of a vector x = (a,a 2 , . . ., a n ) T is defined 
by the equality 

II * Up = (I cti | p + | a 2 p + . . . + | a n nV”, p > 1. (8.0.2) 

The triangle inequality for this norm is called the Minkowski in¬ 
equality. Its proof is based on the following Holder inequality 

S l«*p*l<(3 l a »l P ) 1/P (ij IP*I’ ) 1/7 > 7 + 7 =!. (8.0.3) 

k=l h=l 
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Let X and Y be normed spaces with the norms || x || x and 
|| y || y , respectively. The norm || A || on the space of the operators 
o> xy is said to be consistent with the vector norms on spaces X and 
Y if 

II Ax ||y < II A II II x Ibr (8.0.4) 

for all x £ X and any operator A 6 ^xy- 

If X is a normed space with the norm || x ||, then the norm on the 
space o> XA -, defined by the equality 

MIHsupif^J (8.0.5) 

is said to be subordinate to the vector norm || x ||. Besides the usual 
conditions (8.0.1), the secondary norm also possesses the following 
special property with respect to operator multiplication: 

\\AB || < \\A || || B ||. (8.0.6) 

The definitions of a consistent and subordinate norm can be extend¬ 
ed immediately to spaces of matrices considered as operators on 
arithmetic spaces. In particular, if the norm || x ||p (see (8.0.2)) is 
defined on an arithmetic space, then the corresponding subordinate 
norm is designated by || A || p . The norms || A Hj, \\A 2 ||, || A || w 
are considered most often. 

Even if the matrix norm under consideration is not subordinate, 
we shall assume that equality (8.0.6) is valid for it. 

If a matrix A has the form A = E + 5,\where || B || < 1 for 
some matrix norm, then A is nondegenerate and the norm of the 
inverse matrix can be estimated by: 

lM _1 ll<T=fjr ( 8 -0- 7 ) 

Consider the system of linear equations 
Ax = b 

with a square nondegenerate matrix A and a perturbed system 
(A + e A ) x = b + e b . 

The matrix e A is assumed to satisfy the inequality 

II e A || < IM" 1 II" 1 . 

This condition is sufficient for the matrix A + e A to be nondegene¬ 
rate. If we put 
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then the following estimate is true 

Ifi lM-* < 80 - 8 > 

Here, the matrix norm || A || is assumed to be subordinate to the 
vector norm || x ||. 

The product || A || || A || _1 is called the condition number of the 
matrix A and denoted by cond (.4). If it is necessary to state expli¬ 
citly to which matrix norm a condition number refers, then we shall 
write cond! (4), cond 2 (4) or condao (4). 

As can be seen from estimate (8.0.8), a condition number character¬ 
izes! the sensitivity of a system of linear equations Ax = b to per¬ 
turbations of its coefficients. Matrices with large condition numbers 
are said to be ill-conditioned. 

Suppose an n X n matrix A with the eigenvalues A, lt . . X„ 
is of simple structure, and X is a nondegenerate matrix whose 
columns are the eigenvectors of the matrix A. Then all the eigen¬ 
values of the matrix A + e A are in a region of the complex plane which 
is the union of n circles 

\z — X t | < cond ( X ) || e A ||, i = 1. n. (8.0.9) 

Here, the matrix norm is understood to be one of the norms || A Hu 
II A t \\ v \\A |U. . 


8.1. Normed Linear Space 

In addition to the basic metric notions, another two topics are considered 
in thissection:Jthe equivalence of the norms on a finite-dimensional linear space, 
and a duality relation between the norms and the scalar product. The theory 
of dual norms will make it possible to introduce in the next section a relation 
ordering the set of operator norms. 

8.1.1. Show that the length of a vector in a Euclidean (unitary) 
space fulfils the conditions of a norm. 

8.1.2. Given a fixed basis e v . . ., e„ for an re-dimensional space X 
and an arbitrary vector x from X whose decomposition with respect 
to this basis is 


x = + a 2 e 2 + . . . + a n e„. 


Show that a norm can be defined for X by any of the following equa¬ 
lities 


(a) II x ||! = I <*! | -H a 2 | + . . . + | a„ |; 

(b) II x || 2 = (| <*! | 2 + | a 2 | 2 + . . . + | a„ I 2 ) 1 /*; 

(c) || x |U= max | a |; 

(d) generally, for any positive number p, p > 1, 


II * lip = (I «1 l p + I a 2 | p + . . . + 1 a„ I”) 1 '". 
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8.1.3. Let m (x) and n (x) be two norms for a linear space X. 
Show that 

(a) p ( x ) = max (to ( x ), n (x)); 

(b) q (x) = am ( x ) + Pra(x), where a and (5 are fixed nonnegative 
numbers and never both zero; 

(c) r (x) = (to 2 (x) + n 2 (x)) 1 / 2 
are also norms for this space. 

8.1.4. Let P be a linear nondegenerate operator on a normed 
linear space X with respect to the norm || x ||. Prove that m (x), 

m (x) = || Px ||, (8.1.1) 

is also a norm for the space X. 

8.1.5. A linear space X is the direct sum of subspaces L x and L a 
and, in addition, norms m (x) and n (x) are defined on L Y and L 2 , 
respectively. Let x be an arbitrary vector from X, and let x = x 2 + 
+ x 2 , where x x 6 L u x 2 6 L 2 . Show that a norm on the space X 
can be defined thus: 

|| x || = to (x a ) + n (x a ). 

8.1.6. If the requirement that the norm in the definition of a 
norm should be equal to zero only in the case of the null vector is 
omitted then the vector function thus obtained is called the semi¬ 
norm. Hence, the seminorm j| x || is specified by the conditions: 

(a) II x II > 0; 

(b) || ax || = | a | || x ||; 

(c) II x + y II < II * II + II y ||. 

Prove that if a seminorm || x || is defined on a linear space X , 
then: (a) the set of vectors, for which the seminorm equals zero, is 
a linear subspace L of the space X; (b) all the vectors in the plane 
x 0 + L have the same seminorm; (c) by matching each plane x 0 + L 
with the common value of the seminorm of its vectors, a norm on 
the factor-space of the space X is obtained with respect to the sub¬ 
space L. 

8.1.7. Prove that for any four vectors x, y, z, u of a normed 
space, the following inequality holds 

I II x — y || — || z — u || | < || x — z || + || y — u ||. 

8.1.8. Prove that the sphere || x — x 0 || < r is an open set. 

8.1.9. Prove that the union of any number of open sets is an 
open set. 

8.1.10. Show that any sphere is a bounded set. 

8.1.11. Show that any plane of positive dimension is not a bound¬ 
ed set. 

8.1.12. Show that any sphere is a convex set. 

8.1.13. Show that any plane of positive dimension is a convex 
set. 
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8.1.14. Prove that the sphere || x — x 0 || r is a closed set. 

8.1.15. Prove that the complement of an open set is a closed set. 

8.1.16. Prove that the complement of a closed set is open. 

8.1.17. Show that the intersection of any number of closed sets 
is a closed set. 

8.1.18. Show that the union of any finite number of closed sets is 
a closed set. Set up an example demonstrating that the union of 
infinitely many closed sets may not be a closed set. 

8.1.19. Prove that if x h -+x 0 and y h -*-y 0 , then: (a) ||rc h || 

1| Xq II; (b) || x h — a || -► || x 0 + a || for any vector a; (c) ax h + 
+ Pl/k + Pi/o for any numbers a and 0; (d) if a sequence of 

numbers converges to a number X 0 , then h h x h -+'KqX 0 . 

8.1.20. Prove that if any nontrivial subsequence of a sequence 
{i h } converges, then the sequence {x ft } itself also converges. A subse¬ 
quence is trivial if it coincides with the original sequence from some 
term onwards. 

8.1.21. Prove that if x 0 is a boundary point of a set Af, then there 
is a sequence {a:*,}, x h 6 M, convergent to x 0 . 

8.1.22. Prove that the closure of a convex set is also a convex 
set. 

8.1.23. Prove that a convergent subsequence can be singled out 
from any bounded sequence of vectors of a normed space. 

8.1.24. Prove that any infinite bounded set has boundary points. 

8.1.25. The quantity 

p(x, M) = inf H* —y|| 

V(M 

is called the distance from a vector x to a set M. Show that if M is 
a closed set, then there is y 0 £ M such that p (x, M) = || x — y 0 ||. 

8.1.26. The quantity 

p(M„ M 2 ) = inf ||*— y|| 
x € M„ y £M Z 

is called the distance between the sets M 1 and Af a . Prove that if the 
sets and M z are closed and bounded, then there are x 0 6 
and j/o € such that p (M x , M t ) = || x 0 — y 0 ||. 

8.1.27. Show that the result of Problem 8.1.26 remains valid if 
the requirement for the boundedness of one of the sets Af x and M t 
is omitted. Give an example to demonstrate that this statement 
becomes invalid if neither set (A/ x and M z ) is bounded. 

8.1.28. Are the vectors x 0 and y 0 in Problems 8.1.25, 8.1.26, 
8.1.27 unique? 

8.1.29*. Assume M to be a convex set of a Euclidean (unitary)jspace, 
and consider the length of a vector as its norm. Prove that the 
vector y 0 (see Problem 8.1.25) is determined uniquely in these 
circumstances. 
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8.1.30. Let My and Af 2 be closed bounded sets. Prove that tho 
set N, made up of all vectors having the form x + y, where x £ M lr 
y 6 M 2 , is closed and bounded. 

8.1.31. The sets My and Af 2 are closed, moreover the set My is 
bounded. Prove that the statement of Problem 8.1.30 about the 
boundedness of the set N is also valid in this case. Give an examplo 
demonstrating that when the sets My and Af 2 are closed and not 
bounded, then the set N is not closed. 

8.1.32*. Given that X is a real (complex) linear space. A junc¬ 
tional on X is a mapping from the space X into a set of real (complex) 
numbers. For a normed space X, a functional F (x) is continuous 
at a point x 0 if F ( x k ) -► F (x 0 ) as x h -»-x 0 . A functional F (x) is 
continuous on a set M if it is continuous at every x 0 in M and a 
continuous functional is continuous at every x from X. 

Prove that (a) any linear functional on the space X is continuous; 
(b) if || x || is a norm defined on X, then any other norm m (x) on the- 
space X is a continuous functional with respect to || x ||. 

8.1.33*. Let M be a closed bounded set, and let a functional 
F (x) be continuous on the set M. Prove that there is a positive- 
number c such that | F (x) | ^ c for all x from M. 

8.1.34*. Prove that in the set M (see the previous problem), 
there is a vector x 0 such that | F (x 0 ) | = max | F (x) |. 

MM 

8.1.35*. Prove that for any two norms m (x) and n (x) on a linear 
space X, there are two positive numbers c x and c 2 such that 

cyn (x) < m (x)< c 2 n (x). (8.1.2> 

How can the largest possible number c x and smallest possible num¬ 
ber c 2 be selected? 

8.1.36. For each pair of the three norms || x || x , || x || 2 , || x ||„- 
(see 8.1.2), find the best possible c x and c 2 for inequalities (8.1.2). 

8.1.37*. Consider for n-dimensional arithmetic space, the norms 

l|x || 2 = (|a 1 |*+...+ | «„ |*)V» 

and 

m (x) = || Px || 2 , 

where P is a nondegeneratc n X n matrix. How can the best possible 
constants c x and c 2 in inequalities (8.1.2) be computed? 

8.1.38. Prove that a set M, contained by a space X, and open 
with respect to a norm m (x) on this space, is also open with respect 
to any other norm. 

8.1.39. Prove that a set M, closed with respect to a norm on 
a space X, is also closed with respect to any other norm on this 
space. 

8.1.40. Prove that any plane in a normed space X is a closed 
and not an open set (with the exception of the set X itself). 
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8.1.41*. A set X is the direct sum of the subspaces L x and L 2 . 
A closed set Af x is contained in L lt and a closed set Af 2 in L 2 . Prove 
that the set N made up of all sums x + y, where x £ y £ Af 2 , 
is closed. Note that in contrast to 8.1.31, no condition on the bounds 
of the sets Af x and Af 2 is required here. 

8.1.42. A norm m (x) is considered other than the length of the 
vector on a Euclidean (unitary) space X. Show that for any y from X, 
the expression 

m* ( y ) = sup- 1 ^^ L (8.1.3) 

is always finite and satisfies all the conditions of a norm. This norm 
m* (y) is said to be dual to the norm m (x) with respect to the scalar 
product (x, y). 

8.1.43. Show that the definition of a dual norm is equivalent to 
each of the following expressions: 

(a) m*(y)= sup |(x, y)\\ (d) m*(y) = max; 

m(x)=l x*0 W 

(b) m* (y) = max - ft 1 ; (e) m*(y)= max Re(p, x). 

x+0 m m(x)=I 

(c) m* (y) = max |(x, y)|; 

"!<*)—1 

8.1.44. Show that for any two vectors x and y (see Problem 8.1.42), 
the following inequality is valid 

| (x, y) | < m (x) m* (y). (8.1.4) 

Moreover, for any y there is a vector x 0 such that 
(x 0 , y) = m (xq) m* (y). 

8.1.45. Find the dual norm for the length of vectors. 

8.1.46. Find the dual norm for the norm || x ||„ = max | a t | 

on the n-dimensional arithmetic space with the scalar product de¬ 
fined as (7.1.4). 

8.1.47*. Generalizing 8.1.46, prove that the norm 
II * ||, = (| a, |* + . . . + I a„ |Y/» 
is dual with respect to the norm 

II 1 lip — (l«il p + • • • + |a n l p ) 1/P » P>l’7- + T = 1 - 

What happens to inequality (8.1.4) for this pair of norms? 

8.1.48. Given two norms m (x) and n (x) on a Euclidean (unitary) 
space X and any vector x for which the inequality m (x) ^ n (x) 
obtains, show that for the dual norms m* ( y ) and n* ( y ), the reverse 
relation is valid: m* (y) ^ n* (y) for any vector y. 
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8.1.49*. Prove that for any vector x, there is a vector y such 
that inequality (8.1.4) turns into an equality. 

8.1.50. Show that the norm m** (x), dual to the dual norm 
m * ((/), coincides with the original norm m ( x). 


8.2. Norms of Operators and Matrices 

We give consideration almost exclusively here to matrix space norms, having 
in mind the applications mentioned in subsequent sections. Obviously, all these 
statements can be reformulated for operators. It should be stressed that a matrix 
norm fulfils a further condition related to the operation of matrix multiplication 
in addition to the three usual axioms, namely: 

|| AB || < || A || || B ||. 

Various classes of matrix norms and, in particular, the properties of the 
spectral and Euclidean norms are considered. In the latter case we have listed 
a number of interesting metric relations, similar to those valid for the complex 
plane. In conclusion, properties of subordinate norms and the consistency be¬ 
tween the vector and matrix norms are analyzed. This analysis lends to a relation 
of partial ordering on the norm set. 

8.2.1. Prove that any linear operator transforms a bounded set 
into another bounded set. 

8.2.2. Is it correct to say that an open set is transformed by 
a linear operator into another open set? 

8.2.3. Is it true that a closed set is transformed by a linear trans¬ 
formation to a closed set? 

8.2.4. Prove that a closed and bounded set is transformed to 
a closed set by an arbitrary linear operator. 

8.2.5*. If M is a closed set and A a linear operator, prove that 
the complete pre-image of the set M (i.e. the set of all x for which 
Ax g M) is also a closed set. 

8.2.6*. Let {.4 h } be a sequence of linear operators on a normed 
space X , and assume that for any x from X the sequence {i4 h x} is 
convergent. If 

Ax = lim A k x, 

ft -00 


show',that (a) an operator A, defined by this equality, is linear; 
(b) A k -*-A for any norm on the space of operators. 

8.2.7. Show that the sequence of matrices A h = (a^) converges 
(under any norm) to the matrix A = ( a l} ) if and only if af*’-►o^ 
for all i, j. 

8.2.8. Show that the limit of a sequence of normal matrices can 
only be a normal matrix. Similarly, show that a sequence of unitary 
matrices can only converge to a unitary matrix, a sequence of Her- 
mitian matrices to a Hermitian matrix, and a sequence of positive- 
definite matrices to a positive-definite matrix. 
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8.2.9. Show that for any norm on a matrix space, the norm of the 
unit matrix is not less than unity. 

8.2.10. Let || A || be a norm on the space of re X re matrices. Show 
that the following are also matrix norms: 

(a) M (A) = a || A ||, a > 1; 

(b) L (A) = || A* ||; 

(c) N (A) = || P~ r AP ||, where f is a nondegenerate re-order 
matrix. 

8.2.11. Show that if M (A) and L (A) are matrix norms, then 
N (A) = max{Af (.4), L (.4)} is also a matrix norm. 

8.2.12. Prove that the following function of an re X re matrix 


( 8 . 2.1 > 

is a matrix norm. 

8.2.13. Let E tJ be an re-order matrix, in which the only nonzero 
element is at (i, j) and equals unity. Show that if a matrix norm 
|| A || satisfies the inequality 


for all i, j then 


II Ei) II < 1 

IM II < K (A), 


where K (.4) is a norm defined by the formula (8.2.1). 

8.2.14. The natural scalar product (7.1.4) is defined on the re-di¬ 
mensional arithmetic space. A matrix norm, subordinate to vector 
length in this space, is called the spectral norm and denoted by || A || 2 . 
Prove that the spectral norm of a matrix equals its greatest singular 
value. 

8.2.15. How can the spectral norm be calculated for (a) a diagonal 
matrix, (b) a quasidiagonal matrix? 

8.2.16. Define the scalar product on the space of re X re matrices 
as in (7.1.5). The length of a matrix in the Euclidean (unitary) 
space thus obtained is expressed by the formula 


! M || E = ( j | ii K ?|-)‘ /2 

and called the Euclidean norm of the matrix. Show that for any matri¬ 
ces A and B 

II AB || e < II A || E II B || E . 

8.2.17. Find the Euclidean norm of a unitary re-order matrix. 
8.2.18*. Derive an expression for the Euclidean norm of an 
re X re matrix A in terms of its singular values a lt . . ., a„. 

8.2.19. Prove that the spectral norm of a matrix A equals its 
Euclidean norm if and only if A is a matrix of unit rank. 
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8.2.20. Prove that for any unitary matrices U and V 
II CAY ||, = || A ||„ || UAV ||, = || A II.. 

8.2.21*. Prove the following inequalities: 

(*) IMII*</»IMII,; 

(b) || AB || E < || A ||, || B || E ; 

(c) |\AB ||. < \\A ||. || ||,. 

8.2.22. Let a matrix A have a Hermitian decomposition A = 
= H 1 -r iH t . Prove that 

(a) || H x ||, < || A ||„ || H , || 2 < || A || t ; 

(b) II^iIIb + II^,He=IMIIb- 

8.2.23. Prove that for any Hermitian matrix H 

WA-HWe^WA-H, ii.. 

In this case, the matrix H x from the Hermitian decomposition of A 
is the Hermitian matrix closest in the sense of Euclidean distance 
to matrix A and, similarly, the matrix i/7, is the closest skew Hermi¬ 
tian matrix. Indicate the analogue of this property on the complex 
plane. 

8.2.24. Let A = HU be a polar representation of a matrix A. 
Show that 

II# l&=l|tf||lfc+ll h 2 \\* e . 

Which property of complex numbers does this equality correspond 
to? 

8.2.25*. Prove that for any positive-definite matrix H, the closest 
(in the Euclidean distance sense) unitary matrix is the unit matrix E, 
and the farthest is the matrix — E. What happens if H is a positive- 
semidefinite matrix? 

8.2.26. Let A = HU be an arbitrary polar representation of 
a matrix A. Prove that for any unitary matrix V, the following 
inequalities are valid 

\\A - U ||. < || A - V ||. < \\A + U ||.. 

What is the corresponding property of complex numbers? 

8.2.27*. Let A be an n X n matrix with the singular values 
«!,..., a„. Assuming 

S (A) = a, + . . . + 
prove that S ( A) is a matrix norm. 


( 8 . 2 . 2 ) 
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8.2.28. Prove that for any positive-semidefinite matrices 4 and B 
and any nonnegative numbers a and (5 

S (aA + pfl) = aS {A) + pS ( B ). 


The norm S (A) is defined by (8.2.2). 

8.2.29*. Show that in the definition of a secondary norm 


Mil 


sup may be replaced by max. 

8.2.30. Find subordinate matrix norms for the following norms 
on the rc-dimensional arithmetic space: 


(a) II Zj || = | a, | + . . . + | a„ |, 


(b) || x ||co = max | a, |. 


What are the values of these norms for a diagonal matrix D. 

8.2.31. Prove that for any n X n matrix A, the following equality 
holds 


, < II A* lice 

r/‘ | 0 , ' l "!P«TTiir- 


8.2.32. Norms m (x) and n (a:) on an arithmetic space such that 
for any vector x m (x) — cn (x) where c is a constant number. Show 
that the corresponding subordinate norms are identical. 

8.2.33. Suppose M (A) is a matrix norm, subordinate to a vector 
norm m (x). Find a matrix norm, subordinate to the norm n (x) = 
= m (Px), where P is a constant nondegenerate matrix. 

8.2.34. Let A be a matrix of rank 1 which can be represented as 
the product A = xy*, where x and y are n-dimensional column 
vectors. Given any norm m (x) on the arithmetic space and its cor¬ 
responding subordinate matrix norm M (.4), prove the equality 

M (A) = m (x) m* (y), (8.2.3) 

where m* (y) is the norm dual to m (x) with respect to the scalar 
product (7.1.4). 

8.2.35. Find the value of the norm || A ||® for a matrix having 
rank 1 given that A = xy*. 

8.2.36. If M (A) is a subordinate matrix norm, prove that M (4) 
can be represented as 

(8 - 2 - 4 > 


8.2.37. Prove that the representation (8.2.4) remains valid if, 
instead of all nonzero matrices B, only unit rank matrices are con¬ 
sidered. 
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8.2.38*. Prove that the subordinate matrix norm M ( A) may be 
represented as follows: 


M(A) = n 


I tr (AB)\ 
M(B) 


(8.2.5) 


Here B ranges over the set of matrices of rank 1. 

8.2.39. Given that M (A) and N (/l) are subordinate norms, 
and that M (A) > N (/l) for all A, prove that M (/l) = N (/l). 

8.2.40*. Given that m (x) and m* (x ) are dual norms on an arith¬ 
metic space, and that M (.4) and M* (A) are their subordinate 
matrix norms. Prove that for any matrix A 

M (A) = M* (A*). 


8.2.41*. Prove that any matrix norm is consistent with a certain 
norm on the arithmetic space. 

8.2.42. Show that if a matrix norm || A || is consistent with 
a vector norm m (x) and M (4) is subordinate to m (x), then || A || ;> 
^ M (A) for all matrices A. Thus, the subordinate norm M (/l) 
is the least of all norms, consistent with the vector norm m (x). 

8.2.43*. Prove that any subordinate matrix norm is consistent 
with a unique (dependent on a numerical multiplier) vector norm. 

8.2.44. Show that any subordinate matrix norm M (4) is mini¬ 
mal, i.e. another matrix norm L (4) does not exist, for which 

L(A)^M (4) 

for any matrix A. 

8.2.45*. Let a matrix norm || A || be consistent with a vector 
norm m (x) for which M (.4) is subordinate. Moreover, || A || coin¬ 
cides with M (4) for the set of matrices of rank 1. Prove that m (x) 
is a vector norm (unique for a given numerical multiplier) consis¬ 
tent with || 4 ||. 

8.2.46. Show that the Euclidean matrix norm and the norm S (4) 
(see (8.2.2)) are consistent only with the norm || x || 2 = (|aj | a + . . . 
...-)- | a„ | 2 ) 1/2 (depending on a given numerical multiplier). 

8.2.47. A matrix norm M (4) is subordinate to the unit matrix E. 
Does this mean that M (4) is a subordinate norm? 


8.3. Matrix Norms and Systems 
of linear Equations 

Here the application of matrix norms to the solution of certain systems of 
linear equations is discussed (indeterminate and inconsistent systems have been 
considered in Sec. 7.8). The basic topics are the following: 

Criteria of nondegeneracy of matrices. 

Estimates of norms of inverse matrices. 

The conditioning of a system of linear equations, properties of condition 
numbers. 
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The estimation of a perturbation in the solution of a system for a given 
perturbation of its coefficients. 

Approximate solution of a system and estimation of the accuracy of the 
derived solution. 

8.3.1. Prove that a matrix A + B, where A is nondegenerate 
and || A~ l B || < 1, is also nondegenerate. 

8.3.2. Prove that if a matrix A is nondegenerate and the matrix 
A — B is degenerate, then the condition number of the matrix A 
satisfies the inequality 

cond 

8.3.3. Find the estimate from below for the condition number 
cond* (A) of the matrix 

Hh ! :!• e#o - 

8.3.4. Prove that a matrix U — B is nondegenerate given that U 
is a unitary matrix and the spectral norm of the matrix B is less 
than unity. 

8.3.5*. Let a„ be the smallest singular value of an re X re ma¬ 
trix A . Prove that the distance (in the sense of the spectral norm) 
from the matrix A to the set M of degenerate matrices equals 
P* (A, M) = a„. 

8.3.6*. Prove that the smallest singular value of the matrix of 
the determinant (3.3.1) does not exceed 

8.3.7*. An re-order matrix A has the singular values a x ^ . . . 

. . . ^a„. Prove that the distance (in the sense of the spectral 
norm) from the matrix A to the set M r of matrices, whose rank is 
less than r, is equal to 

p 2 ( A, M r ) = a „ r = 1, 2, . . re. 

8.3.8. An n-order matrix A is said to be diagonally dominant 
{with respect to its rows) matrix if 

*=i. n. 

Prove that a diagonally dominant matrix is nondegenerate. Formu 
late a similar criterion for dominance with respect to its columns. 

8.3.9*. Let d be a partitioned matrix of the form 
| A 21 A 12 ... Ajj, II 

_ •‘*21 ■‘*22 ... d 2 fc 

dfc! Aft 2 ... A fcfc II 
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where all the blocks A l} are square and have the same order m, 
and the diagonal blocks An are nondegenerate. Moreover, for all i, 
1 ^ i ^ k, the following inequalities hold true: 

II Au> II (II A ti ||+ ... + II A t ,II + II At . (+ , II +... + II A lh II) < 1. 
Prove that the matrix A is nondegenerate. What happens when 
m = 1? 

8.3.10. Is the matrix 

II 0 1 0.1 —0.211 

1 0 -0.1 0.1 

0.4 0.5 2 1 

1-0.5 0.4 1 1 || 

nondegenerate? 

8.3.11*. Assume that A is a diagonally dominant rc-order matrix 
and for a certain positive number a < 1 

a l®» I^Sjl®!;!’ » = 1* .... re. 

Prove that for the norm of the inverse matrix A~ l the estimates 
are true: 

8.3.12. Estimate from below and from above the condition num¬ 
ber cond« (A)](see Problem 8.3.11) in terms of the diagonal elements 
of the matrix A and the number a. 

8.3.13. Estimate from below and from above the condition num¬ 
ber cond« ( A) of the n X n matrix 


1 

10-1 

io-» 

... 10-<»"i) 

10-1 

2 

10-* 

... 10-( n -D 

10-1 

io-i 

3 

... 10—<""*) 

lO-(Tl-l) 

10 -(n-l) 

io-< n -‘) . 

... n 


8.3.14. Let R be a triangular W-order matrix for which 

(a) I r,j | < 1 for all i, f; 

(b) r (l = 1 for all i. 

Find the maximum possible value of the condition number condoo(if). 

8.3.15. Given a sequence of matrices A h of a fixed order n, with 
II || = 1 and cond (Aft) -*■ oo as k ->-oo. Prove that det A h -»-0 
as k oo. 

Thus, for a fixed order of a matrix an increase in the condition 
number is related to a decrease in determinant size. However, as is 


0819 
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shown in 8.3.14, for a sufficiently large n, the condition number of 
a matrix may be very large even if its determinant equals 1. 

8.3.16. Show that the condition number of any matrix has a low¬ 
er bound of 1. 

8.3.17. Show that the condition number cond (4) is unaltered 
when the matrix A is multiplied by a nonzero number. 

8.3.18. Find the expression of the spectral condition number of 
a nondegenerate normal matrix A in terms of its eigenvalues A. x , . . . 

. • K. 

8.3.19. Find the expression of the spectral condition number of 

a nondegenerate n X n matrix A in terms of its singular values 
OCJ ^ a 2 ^ ^ a n . 

8.3.20. Show that the equality cond 2 (A) = \ occurs if and only 
if A = a U, where U is a unitary matrix and a is a nonzero number. 

8.3.21. Show that the condition numbers cond Xi 2i E (4) are 
unaltered when the rows and columns of the matrix A are inter¬ 
changed. 

8.3.22. Show that the spectral and Euclidean condition numbers 
of a matrix A are unaltered when it is left-multiplied and right- 
multiplied by arbitrary unitary matrices U and V. 

8.3.23. Prove the inequalities 


S' Sw)« Ml1 <■ B )• 

8.3.24. For a nondegenerate 2x2 matrix A, give an explicit 
expression of the Euclidean condition number cond E (X) in terms 
of the elements of this matrix. 

8.3.25. Show that the matrix 

n lOO 99 II 
99 98 || 

has the greatest Euclidean condition number among all nondegene¬ 
rate 2x2 matrices whose elements are nonnegative integers not 
exceeding 100. 

8.3.26. The solution of a system of two linear equations in two 
unknowns: 

a u x + a 12 y = a lt a 21 x + a 22 y = a 2 
with a real and nondegenerate matrix A is equivalent to the geomet¬ 
ric problem of finding the point of intersection of two straight lines 
determined by the equations of the system. Prove that the angle a 
between these straight lines satisfies the inequality 

|cota| cond E (/l). 


8.3.27. If A is a positive-definite matrix, prove that the spectral 
condition number of the matrix A -f- a E is a steadily decreasing 
function of a when a > 0. 
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8.3.28. Suppose A is a positive-definite matrix and A h is an 
arbitrary principal submatrix of the matrix A. Prove that 

cond 2 (A h ) ^ cond 2 (A). 

8.3.29. Let A = S T S be a triangular decomposition of a real 
positive-definite matrix A. How are the spectral condition numbers 
of the matrices A and S related? 

8.3.30. Estimate from below the spectral condition number of 
the matrix of the system of linear equations 

1 Ox, + 10x 2 + 30*3 — — 5, 

0.1*,+ 0.5*2+ 0.1*3 = 0.55, 

0.03*, + 0.01*2 + 0.01*3 = 0.045. 

Indicate a method to decrease the condition number so that in the 
obtained system Ax = b cond 2 (.4) = 3. Find the solution of this 
system. 

8.3.31*. Estimate from below the spectral condition number of 
the matrix of the system 

*,+ 20*2—400*3 = 1, 

0.2*,- 2*2- 20*3 = 0.2, 

— 0.04*, —0.2*2+ *3 = 0.05. 

Indicate a method for decreasing the condition number so that in 
the obtained system Ay = b, cond 2 (X) = 2. Find the solution 
of this system. 

8.3.32. Let || * || be a norm on an arithmetic space, and let || A || 
be its subordinate matrix norm. Show that when the right-hand side 
of a system of linear equations Ax = b is replaced by a vector with 
the norm e > 0, the solution of the system can be changed to a vec¬ 
tor with the norm e || A -1 ||. 

8.3.33. Estimate the possible perturbation of the system 

x- 2y= — 1, 

— 2* + 4.01y = 2 

when the components of the right-hand side are changed by 0.01, 
Find the solution of this system and of the system with the same 
matrix and the right-hand side 



8.3.34. Find the condition number cond« (A) of the matrix of 
the system 

5* — 3.31y = 1.69, 

6* - 3.97 y = 2.03. 

16* 
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Indicate the change of the solution of this system in the transfer 
to the system with the same matrix but with the right-hand side 
being 


8.3.35. Find an approximate solution of the system 
2.503*, +0.002;r 2 - 0.004*s + 0.001** = 5, 
0.006*, — 3.002*2 + 0.001*3 - 0.001** = 3, 
- 0.002*, + 0.002*2 + 4.998*s + 0.004** = 10, 


0.005*, - 0.001*2 + 3.997** == 4 

such that the error in each component may not exceed 0.01. 
8.3.36. Find an approximate solution of the system 


0.501 *,-0.499*2 + 0.001*3 =0.5, 

'0.498*,+ 0.502*2 -0.001** = 0.5, 

0.006*, + 0.007*2 + 3.008*j -1.991** = 0, 

- 0 . 001 *, - 2 . 001 *,+ 1 . 000 ** = 0 


such that the error in each component may not exceed 0.06. 
8.3.37. Prove the inequality 




8.4. Matrix Norms and Eigenvalues 

In this section we intended to demonstrate some of numerous applications of 
matrix norms to problems involving the eigenvalues of complex matrices. 

Some inequalities connecting the eigenvalues and the matrix norms are 
considered at first. These inequalities can be used to specify a region on the 
complex plane containing all the eigenvalues of a matrix. The Gershgorin 
theorem (see Sec. 8.4.20) and a theorem on eigenvalue perturbations (see Sec. 8.0) 
can also be applied for the same purpose. 

Using the properties of the eigenvalues of Herraitian matrices, the pertur¬ 
bation theorem can be modified so as to derive an estimate of each individual 
eigenvalue (see Problems 8.4.25-8.4.32). 

Given an approximation to a well-separated eigenvalue ^ and the corre¬ 
sponding approximate eigenvector x of a normal matrix, the Rayleigh ratio for 
the vector x gives an approximation to X, with considerably higher accuracy. 
We discuss this point in Problems 8.4.33-8.4.39. 

Finally the relation between close eigenvalues of a matrix and ill-conditioning 
of the eigenvector matrix is investigated. It is easy to demonstrate that in a small 
neighbourhood of a matrix with close or multiple eigenvalues, there is a matrix 
with Jordan structure. The latter can be considered as the limiting case of a 
matrix with ill-conditioned eigenvectors. \s it was established by Wilkinson, 
the converse relation is also true: if for a matrix A (even with well-separated 
eigenvalues) the matrix of the eigenvectors is ill-conditioned, then in a small 
neighbourhood of A there is a matrix with a multiple root. 
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8.4.1*. Prove that for the spectral radius of a matrix A, the 
following inequality holds 

P MX II A || (8.4.1) 

for any matrix norm || A ||. 

8.4.2. Indicate a circle on the complex plane containing all the 
eigenvalues of the matrix 

II-1 0 l+2i 

0 2 1 + . 

|| t + 2i 1 + i 0 


8.4.3. Prove that all the eigenvalues of the matrix 

|| t -2 3 4 || 

2 1-1 ° 

1 -2 0 1 
|| 1 1 2 -1 || 

lie within the circle of the complex plane \ i | < 6. 

8.4.4. Show that the greatest eigenvalue and the least eigen¬ 
value A. 4 of the symmetric matrix 

|| 6 2 -3 0 || 

2 9 5 1 

-3 5 13 -2 

|| 0 1 -2 20 || 

satisfy the inequalities 

20<X! <23, 0<X 4 <6. 

■ 8.4.5. Prove that the moduli of all the eigenvalues of a stochastic 
matrix do not exceed unity. 

8.4.6. Prove that the eigenvalues of a tridiagonal matrix 

i: * II 


c= 


C 3 a 3 . 


satisfy the inequality 


«n-i >>n 
Cn <*n 


|A.|<max{|a,| + |6 l+ il + |C||}> c, = 6 n+l = 0. 


How can this result be used to evaluate the eigenvalues of a Her- 
mitian matrix by the bisection method? 
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8.4.7. Prove that all roots of a polynomial / ( z) = a n z n + 
+ a„ -jz” -1 -r . • • -r « x z + a 0t « n # 0, are contained in each of 
the following circles on the complex plane 

(a) | S Km.x{l,|^-|+...+|-^|+|-^-|} ; 

(b) i + 

8.4.8*. Let A 0 be a matrix of simple structure. Prove that there 
is a matrix norm || A || such that when A = A 0 (8.4.1) becomes an 
equality relation. 

8.4.9*. Let A 0 be an arbitrary matrix. Prove that for any posi¬ 
tive number e, there is a matrix norm || A || for which || A 0 || < 
<p(x4 0 ) + e. 

8.4.10. Prove that for a normal matrix A iy || A 0 || 2 ^ Af (x4 0 ) 
for any matrix norm M ( A ). 

8.4.11. Prove that for an arbitrary matrix A 0 and any matrix 
norm M (A), || A 0 || t < VM (A 0 ) M (-4J). 

8.4.12*. Let A be a matrix of order n with the eigenvalues 
Xj, . . ., X n . Prove the following Sckur inequality 

(8-4.2) 

8.4.13*. Let a x , . . ., a n and p it . . ., p„ (see Problem 8.4.12) 
be the real and imaginary parts, respectively, of the eigenvalues 
k lt . . X n . Prove that 

(a) 4g a? <|| A + A* |||; (b) 4j p\^\\A-A* |||. (8.4.3) 

8.4.14*. Prove that equality occurs in (8.4.2) if and only if A 
is a normal matrix. The same is true for each of relations (8.4.3). 

8.4.15*. Let A be an n X n matrix with the eigenvalues ... 
. . ., A,„, and let P be an arbitrary nondegenerate matrix. Prove 
that 

inf||P-MP||i = 2|^|*. 


For which matrices A is the indicated lower bound reached? 

8.4.16*. Using 8.4.14, prove that the normality of matrices A, B 
and AB implies the normality of BA. 
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8.4.17*. Suppose that a normal matrix A is partitioned into 
blocks A u so that 



and, moreover, the diagonal blocks A tl are square, though perhaps, 
of different orders. Further, assume that the eigenvalues of the 
matrix A coincide with the set of the eigenvalues of the matrices A tl . 
Prove that then all the off-diagonal blocks A ti equal zero. 

8.4.18*. Let Xj, . . ., X n be the eigenvalues, and let o lt . . ., a B 
be the singular values of a matrix A. Prove that 

| Xj | -f . . . + | | ^ a x + • • • + a„. 

8.4.19*. Using 8.4.18, prove that for any matrix A of order n, 

8.4.20*. Prove the following Gershgorin theorem: all the eigenval¬ 
ues of an n X n matrix A lie in a region of the complex plane given 
by the union of n disks 

8.4.21. Indicate a region on the complex plane containing all 
the eigenvalues of the matrix 

II 1.23 0.03 0.04 M 
0.03 2.17 0.01 . 

|| 0.02 0.04 3.06 || 

8.4.22. These inequalities are valid for a matrix A 

Re an < — ^ i = 1. • • ■, ft. 

Prove that A is a stable matrix. 

8.4.23. Using the theorem about a perturbation of the eigenval¬ 
ues, indicate a region on the complex plane containing all the eigen¬ 
values of the matrix 


2.001 1.499 0.001 

0.499 1.001 -0.001 
—0.001 0.001 0.999 
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8.4.24. Let 


A = 

-2 - 

2 

1 2 

1 0 

, B = 

-1 1 -1 

1 -1 1 


0 

0 1 


-1 1 -1 


Find a region on the complex plane containing all the eigenvalues 
of the matrix A + eB, using the theorem about a perturbation of 
the eigenvalues. 

8.4.25*. Let A and B be Hermitian matrices, and let X lt . . A,„ 

be the eigenvalues of the matrix A. Prove that in each interval 
— || || t < * — Jl, < || 2Ml t , i = 1. • ■ n, (8.4.4) 

there is at least one eigenvalue of the matrix A + B. 

8.4.26. Let A, lt \ t , \ 3 and p x , p s , p 3 be the eigenvalues of the 
matrices A and B , respectively, where 


2 3—2 

2.1 

2.9 -2 

3 1 0 , 

B= 2.9 

0.9 0.1 

-2 0 -1 

—2 

0.1 -1 


Prove that for each there is such p.; that | X t — | ^ 0.3. 

8.4.27*. Find eigenvalues of the matrix 


2.10” 1 

-3 

4 

9991 

—3-10 - ® 

1 -10 -4 

-0.4993 

-6-10-« 

4-10-® 

—0.4993 

2-10-* 

-2-10-® 

0.9991•10 -4 

—6-10 -4 

—210-* 

M0-* 


approximately, so that the error in each does not exceed 0.002. 

8.4.28. Let an eigenvalue A,j (see Problem 8.4.25) be of multipli¬ 
city k. Prove that then the interval 

- || 5 || a ||£ ||, 

contains at least k eigenvalues of the matrix A + B. 

8.4.29*. Find approximations to the eigenvalues of the matrix 
II 1.01 -1.99 0.01 0.01 || 

—1.99 1.01 -0.01 -0.01 

0.01 -0.01 -0.01 -0.99 

I 0.01 —0.01 -0.99 -0.01 || 

such that the error in each eigenvalue does not exceed 0.02. 

8.4.30. Let the region D, made up of the intervals (8.4.4), be 
broken into regions (i.e. intervals) having no common points. Prove 
that in each of these regions D h , there are as many eigenvalues of 
the matrix A + B (see Problem 8.4.25) as there are intervals in the 
set (8.4.4) that compose this region. Moreover, if X t is a multiple 
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eigenvalue of A, then its corresponding interval is counted as many 
times as the multiplicity of X { . 

8.4.31. A Hermitian matrix A is partitioned into blocks 
Ax. A lt 
Aft A „ 

so that A u and A a2 are square and || A 12 || 2 = e. Let \ 2 , . . X n 
be the eigenvalues of the matrix A numbered in descending order, 
and let £ r be the eigenvalues of A u , and r) lt . . r| n _ r 

the eigenvalues of A 22 . Finally, let p lt . . ., p„ be the numbers of 
the set £i, . . ., £ r , %, . . ., T|„_ r also numbered in descending 
order. Prove that | X t — p ( | ^ e, i = 1, . . ., n. 

Thus, the eigenvalues of the diagonal blocks can be taken as 
approximations to the eigenvalues of the matrix A itself with an 
accuracy of c. 

8.4.32*. Prove that the following matrix A of order 8 


1 

1 IN 

0 



1 IN 

1 IN 

1 

2 /N 




0 

2 IN 

1 







2 1 IN 

1 /N 2 







- 0.5 

0.1 - 0.2 





0.1 

-1 0 

1 IN 




- 0.2 

0 2 


(the matrix A is quasi-diagonal to the accuracy of the elements 
positioned in (1.8) and (8.1)): 

(a) for any N > 0, has at least one eigenvalue in the interval 


__ VI 

N 


0-1 




J 11 . 

N ’ 


(b) for Af ^ 10 has precisely three eigenvalues in the interval 


In Problems 8.4.33-8.4.35, it is assumed that A is a normal ma¬ 
trix and x is a column vector normed so that || x || 2 = 1. 

8.4.33. Let || Ax || 2 = c. Prove that the matrix A has an eigen¬ 
value A, for which | X | ^ e. 

8.4.34. Assume for an arbitrary number p that c = || ^4x — px || 2 . 
Show that there is at least one eigenvalue of the matrix A in the 
disk on the complex plane | z — p | ^ c. 
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8.4.35*. Let Xj be an eigenvalue of a matrix A lying in the disk 
| z — n 0 | ^ e (e is defined as in 8.4.34), and let for all the other 
eigenvalues A,,, . . A,„, the condition be fulfilled 

I h — He I > a. » e. 


If the normed eigenvector associated with the eigenvalue ^ is denot¬ 
ed by e 1 and 

x = ae, + z, (8.4.5) 

where z _L e lt prove that 

(a) || Az — p 0 z ||j > a || z || 2 ; 

(b) || Az - |x 0 z || 2 < e, || z || 2 < e/a; 

(c) |a|>V r l-e*/« # ; 

(d) | (Az, z) - |i 0 II * lit I < e*/«. 

Thus, if e is sufficiently small compared to a, then x can be con¬ 
sidered as an approximation to e v 
8.4.36. Let A be a matrix of order n, x an arbitrary nonzero n- 
dimensional column vector. The number 


is called the Rayieigh quotient corresponding to the vector x. Prove 
that for any number p 

I \Ax — r (x) x || 2 < \\Ax — pa: ||,. 

8.4.37. Prove that for a normal matrix A and any normed vec¬ 
tor x, the disk 

|z-r£)|<(||^ ||J — | r(x) W 

contains an eigenvalue of the matrix A. 

8.4.38*. Assume that p 0 (see Problem 8.4.35) is the Rayleigh quo¬ 
tient corresponding to the vector x. Prove that the estimate is valid 

(8-4.6) 


8.4.39. For a symmetric matrix A 

II 1 0.001 0.002 0.002 

0.001 2 0.002 0.002 

0.002 0.002 3 0.001 

|| 0.002 0.002 0.001 4 

(a) with the aid of 8.4.25 find the eigenvalues to an accuracy 
of 0.005; 
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(b) show that the diagonal elements of A can be considered as the 
Rayleigh ratios if the corresponding vectors have been given; 

(c) prove that the diagonal elements are approximations to the 
corresponding eigenvalues to an accuracy of 10 -5 . 

8.4.40. Let all the eigenvalues X lt . . ., X„ of a matrix A be 
different and d = min | X t — kj |. Prove that there is a matrix B 

for which || B || 2 ^ d/2 and the matrix A + B has a multiple eigen¬ 
value. 

8.4.41*. Prove that (see Problem 8.4.40) for any number e > 0, 
a matrix C t can be found such that || C t || 2 < y + e and the 
matrix A + C e is not simply structured. 

8.4.42*. All the eigenvalues X lt . . ., X n of a matrix A are differ¬ 
ent. Let x t be an eigenvector of the matrix A associated with X it y t 
an eigenvector of the matrix A* corresponding to X ( . Put 



For real x, and y t , the number s t is the cosine of the angle between 
these vectors. It is obvious that | s t | is independent of the selection 
of a concrete pair of vectors x t , yt (for the given X t ). 

Prove that 

(a) for any matrix X made up of the eigenvectors of the matrix A, 

cond 2 (X)>-j^p i=l, 

(b) a matrix X can be selected so that 

cond 2 (X)<cond B (X) = 2- f ^ r . 

i=l 

Thus, the value of | s t |, together with its condition number, can 
serve as a measure of the conditioning of the eigenvector matrix. 

8.4.43. Let C be a triangular matrix 



and let the first component of some eigenvector y of the conjugate 
matrix C* associated with the eigenvalue be equal to zero. Prove 
that Xy is a multiple eigenvalue of C. 

8.4.44. Matrices A and A* possess the eigenvectors x and y, 
associated with X, and X„ respectively, and, in addition, (i, y) =0. 
Prove that X, is a multiple eigenvalue of A. 
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8.4.45*. Write the matrix C (see Problem 8.4.43) in the parti¬ 
tioned form 



We will assume that the eigenvector y of the matrix C*, associated 
with the eigenvalue A,, to be normed, and require instead of p! = 0, 
that p! = e, | e | < 1. Represent the vector y in the form 


Prove that A,! is an eigenvalue of the matrix 

8.4.46. Prove that (see Problem 8.4.45) there s a matrix C such 


that 

(a) ||C-C|| 2 < 


Ul 


-IIC ||,; 


1/1— Ie|* 

(b) C has a multiple eigenvalue Aj. 

8.4.47. Let x and y be the normed eigenvectors of matrices A 
and A* corresponding to A 2 and A 2 , respectively. Moreover, | s | = 
= I (*. y) I = e <g. 1. Prove that there is a matrix A such that 


(a) \\A-A ||,< || A || 2 ; 


(b) A has a multiple eigenvalue A 2 . Thereby, the fact that conju¬ 
gate matrices possess a pair of almost orthogonal eigenvectors asso¬ 
ciated with the conjugate eigenvalues, testifies that there exists 
a close matrix with a multiple eigenvalue. 



Hints 


1.1.18. Using only the distributivity and the existence of the opposite 
element, prove that 0 -x — 0 for any vector x. Hence, deduce that (—1)-x = — x. 
Finally, using the associativity of addition, prove that x + y = y + x. 

1.2.28. Write a linear combination X^, + . . . + of the vectors x,, . . . 

. . ., x 4 . If we assume that there are nonzeroes among the coefficients X,, . . ., X s , 
and that /.j has the maximum modulus, then we have to show that the y-th com¬ 
ponent of the vector X,x, + . . . + X*x 4 is different from zero. 

1.3.16. Use Theorem 15.1 (see the text-book by V. Voyevodin, p. 50). 

1.3.25. Use 1.3.17 and 1.3.19. 

1.3.26. Show that each elementary transformation leads to an equivalent 
vector set. 

1.3.34. Let the rank of the vector set x,, . . ., x s be r. Then, the first r rows 
of the matrix, obtained from the reduction to trapezoidal form (see the solution 
of Problem 1.2.18), will be nonzero. Let them correspond to the rows numbered 
i,,..., t r in the original matrix. Prove that the vectors X| t ,.. ., x Jr make a base 
for the given set. 

1.3.36. Set up the reduction so that the zero elements are positioned in the 
lower right comer of the matrix. 

1.3.39. If xj = a,x ti + . . . + a,X| r , then any vector, for which the coef¬ 
ficient a/ in this decomposition is different from zero, can be taken as x (( . 

1.3.44. Use 1.3.23. 

1.4.41. Extend an arbitrary basis for the subspace L to form a basis e,, . . . 
.... of the space I'. Obtain the basis fulfilling the conditions of the problem 
by elementary transformations of the set e„ . . ., e n . 

1.5.16. Use 1.5.14. 1.5.18. Use 1.5.16. 

2.1.2. Let e t , be a basis for the given linear space. But 

(x, y) = OiPi + ... + <x n p„ 

for arbitrary vectors x = cti?, + . . . + a n e n and y = P,e, + . . . + P„c n . 
Verify that all the requirements for a scalar product are fulfilled. 

2.1.8. Prove the necessary condition ac > A* by considering the scalar 
square (x, x) of a vector of the form x = (o lt 1) as a quadratic trinomial of a v 

2.1.9. Derive the representation 

(x, x) = «}+ (3oj + a*) 2 + (a 2 + a 3 ) 2 

for the scalar square of the vector x = (a lt a t , a 3 ). 

2.1.10. Use the inequality 2 I a l} | | ctj | | a.j | < | a tj \ \ a, |* + | a l} | | 2 

to verify the fourth requirement for a scalar product. 

2.1.15. Define a scalar product arbitrarily on the subspace, complementary 
to L. Then use 2.1.13. 

2.1.16. See Voyevodin, Theorem 27.2, p. 93. 

2.1.18. (d) Use 2.1.16. 

2.2.23. For each i, 1 < i < k, the vectors y u . . ., y t and z 1 , . . ., z t form 
an orthogonal basis for the span drawn on the vectors x lt . . ., x { . Therefore 
('//, z m ) = 0 when l # in. 

2.2.25. See the hint to Problem 2.1.2. 
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Hints 


2.3.7. (a) Interpret each equation of the system as a condition of the ortho¬ 
gonality of the vector z = (a,, . . . a„) to the vector made up of the coefficients 
of the equation. 

2.3.9. Use the basis for the orthogonal complement derived in 2.3.6. 

2.3.11. See the solution of Problem 2.3.10. 

2.3.14. The coefficients of the equations of the system give the coordinates 
of the vectors on which L 1 is drawn. By the method of Problem 2.3.10, find the 
perpendicular z, and then y as the difference x — z. 

2.3.27. Set up a basis for 1' as the union of bases for the subspaces L x , ... 

. . ., L,„ and define a scalar product on I' by 2.2.25. 

2.4.16. Show that in the decomposition of the vector x, x = y + z where 
if £ t, * 1 t, the vector y 6 L x and, therefore, the perpendicular from x to L t 
coincides with the perpendicular z from x to L. 

2.4.17. The perpendicular z from the vector x to L is collinear with the 
vector a. 

2.4.19. Use 2.4.17. 

2.4.20. In evaluating the cosine of the angle between x and an arbitrary 
vector u of the subspace L use the decomposition x = y + z where y £ L, z ± L. 

2.4.23. See the hint for 2.4.16. 

2.5.2. As in Problem 2.1.2 (see the hint), fix a basis_e lt .. ., e n and for arbi¬ 
trary vectors x and i/ assume (x, y) = a,B, + . . . + a_B . 

2.5.5. See the hint for 2.1.10. 

2.5.13. (c) Show that if e^, . . ., e n is a basis for the space R, then any vector 
from C is a linear combination of the vectors e x + 10, . . ., e n + 10. 

3.1.21. Derive the iterative formula m n = mn-i + 1 for the number m n 
of nonzero terms in the determinant of order n. Here % = 1. 

3.1.22. Derive the iterative formula m„ = m n _, + m n _, for the number m„ 
of nonzero terms in the determinant of order n. The general solution of such 

an equation is (see Sec. 3.0) m n =* c x (!iLkl!)+ c* ( 1 ~ . The 

constants c, and c s are determined from the equalities m x = 1, m, = 2. 

3.1.23. Derive the iterative formula m n = 2m„_, for the number m„ of non¬ 
zero terms in the determinant of order n. In this case m x = 1. 

3.1.25. Let P n (<) be a determinant of order n of the indicated form. Derive 
the following iterative formula: P n (t) = tP n . x ( t) -f a,. 

3.1.34. Snow that the given transformation of the determinant is equivalent 
to multiplication of its rows by a, a*, . . ., a n , respectively, and its columns by 
a -1 , a -! , . . ., a _n , respectively. 

3.1.35. Use 3.1.34. 3.1.36. Transpose the determinant. 

3.1.37. Transpose the determinant. 3.1.40. Use 3.1.38. 

3.1.42. Transpose the determinant and use 3.1.40. 

3.1.43. The indicated transformation of the determinant can be replaced by 
transposing it about the principal diagonal and reversing the rows. 

3.1.44. A polynomial of the fourth degree cannot have more than four differ¬ 
ent roots. 

3.1.56. Differentiate the general term of the determinant. 

3.2.6. Use 3.1.35. 

3.2.20. The given determinant has an almost triangular form. When this 
determinant is expanded by the first two rows, the sum contains only three 
terms. 

3.2.26. Expand the determinant by the first three columns. 

3.2.33. Subtract the first row from the second, third and fourth. 

3.2.45. Show that for a determinant d n of the indicated form, the iterative 
formula d n — 2 cos ad , — d__ 2 is valid and d x = cos a, d t = 2 cos* a — 1 = 
= cos 2a. 
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3.3.1. The vector b t is obtained from a t by subtracting a linear combination 
of the vectors a lt .... ai^. 

3.3.15. See V. Voyevodin, Theorem 41.2, p. 134. 

3.3.16. Any principal minor of a Gram determinant is itself a Gram deter¬ 
minant with respect to a subset of a given vector set. 

3.3.17. Use 3.3.14. 3.3.18. Use 3.3.17 and 3.3.13. 

3.3.23. Use 3.3.17 and 3.3.13. 3.3.24. Use 3.3.18. 

3.3.25. The length of the perpendicular dropped from the vector x J+1 to the 
span of the vectors * lt . . ., x t does not exceed the length of the vector itself; 
the length of the perpendicular dropped from the vector xj, l + 1 < / < k, to 
the span of the vectors x lt . . ., x } . lt does not exceed the length of the perpen¬ 
dicular dropped from the same vector to the span of the vectors X(+i, . . ., xj. v 

3.3.32. The element positioned in (n, 1) should be replaced by (—l) n •2 - < n - 1 ). 

3.4.3. Use 1.2.28. 

3.4.4. Use 3.3.25 and 3.4.3 to prove the latter statement. 

3.4.8. Transpose the minor M to the upper left corner and use the Gauss 
elimination. 

3.4.9. Use 3.2.11, recalling that the Gauss elimination consists of a sequence 
of elementary row and column transformation. 

3.4.16. Before applying the Gauss elimination, decrease the value of the 
terms of the determinant by elementary transformations. 

3.4.17. Reduce the elements of each row to their common denominator and 
use 3.4.16. 

3.4.19. Take the common factor of the elements in each row outside the 
bracket. 

3.4.20. See the hint for 3.4.16. 

3.4.24. The determinant is obtained by enclosing the determinant of 
Problem 3.4.10. 

3.4.26. The determinant is obtained by enclosing the determinant of 
Problem 3.4.24. 

3.4.35. (b) Use the formulae of the (k + l)th stage of the elimination method, 

h+ 1 

recalling that the moduli of ratios -, « > k + 1, are bounded by unity. 

a h, *+l 

. 3.4.41. Carry out the transformation that reduces the matrix A to triangular 
form over each of the n sets from the n rows of the determinant D. The matrix 
of the determinant obtained will contain m 2 triangular blocks. Using the Laplace 
theorem, this determinant can be expanded as in 3.2.27, (b). 

4.1.2. Prove that the rank of the set of columns is n — 1. 

4.1.3. Using 4.1.2, prove that the columns of the matrix A, containing the 
minor M, form a base of the vector set. 

4.1.4. Use 1.3.39. 

4.1.6. Consider the submatrix formed by the given r linearly independent 
columns. Show that the rows, in which the given minor is placed, are tne basis 
rows for the submatrix. 

4.1.9. The rank of a Gram matrix equals the highest order of nonzero prin¬ 
cipal minors of this matrix. For the principal minors of a Gram matrix see 3.3.16. 

4.1.11. Use 3.1.36. 

4.1.12. The first r columns contain at least one nonzero minor of order r. 

4.1.20. The indicated increase in the rank can be achieved by changing the 
elements of the minor that is complementary to the basis minor. 

4.1.22. Use 4.1.19. 4.1.29. The rows of the matrix are orthogonal. 

4.1.30. See 1.2.28. 

4.1.36. Prove that the minor of order k placed in the left-hand corner is 
nonzero. 

4.2.5. Use 4.2.4. 4.2.9. See 1.4.38. 
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4.2.19. Set the isomorphism between M and an arbitrary subspace, comple¬ 
mentary to L. 

4.2.33. That the intersection is a plane follows from 4.2.14. Moreover, if 
Li, . . L h are the directional subspaces of the given hyperplanes, then 
dim (Jii fl • • • fl **) = dim (L 3 fl ... fl L k ). 


Now, prove by the method of induction that in an n-dimensional space the 
dimension of the intersection of k(n — l)-dimensional subspaces is not less 
than n — k. 

4.3.3. If .1 = i 0 + £ n -i is a given hyperplane, then any nonzero vector 
from Ln-i can be taken as the vector n, writing it as (n, x) = 6. In this case 
b = («. *o)- 

4.3.9. (a) follows from 4.3.8; (b) follows from 4.2.34 and 4.3.7. 

4.3.11. Use 4.2.6. 

4.3.17. It is obvious that length in a Euclidean space possesses the property 
p (or, u) = p (x — x 0 , u — *,,)• 

4.3.20. See the hint for 4.3.17. 

4.3.24. Note that L (p lt />,, g lt g t ) can be described by the equation a 3 = 0. 

4.3.25. The vector x 0 — y 0 is orthogonal to the subspace L (p lt p t , g lt g t ). 

4.3.27. Define a scalar product on the space so that the given basis may 
become orthonormal. 

4.3.28. See the hint for 4.3.27. 

4.3.29. Let e lt . . ., e h be a basis for the directional subspace of the plane/*. 
Extend the linearly independent set . . ., e h , x to form a basis for the space, 
and then define the scalar product with the aid of this basis. 

4.4.2. The subspaces L («,, . . ., u-) and L (u,, . . ., v,) must coincide. 

4.4.11. See 4.4.10 and 4.4.3. 4.4.12. Use 4.4.10. 

4.4.24. Change the variables by putting t. = 3x 1 and t. = 2x~, 

4.4.28. Use 4.1.36. 

4.4.30. Find a basis for the orthogonal complement to L (y lt y t , y «). 

4.4.32. If an arbitrary n-th row is adjoined to the system matrix then in 

the obtained square matrix, the numbers (—1) ( A t are (to the accuracy of the 
sign which is tne same for all n numbers) cofactors of the elements of the n-th 

4.4.34. Use 4.4.32. 4.5.3. Use 4.5.2. 4.5.10. See 4.4.14. 

4.5.18. Change the variables by putting = 6x!, t 2 = 3z lt f, = llz s , 
t 4 = — 5x 4 . 

4.5.19. Multiply the third equation of the system by 10, the fourth by 10 _l , 
and then make the substitutions: t, = 1000z lt t, = 0.001z 8 , t. = 0.1z s , 
l t = 10r.. 

4.5.34. See 4.4.28. 

4.5.36. Construct the general solution of the given system of equations and 
find the fundamental system of solutions of the reduced homogeneous system. 
Note that a normal solution should be orthogonal to this fundamental system. 

4.5.48. Express the polynomial f (!) in terms of the basis 1, t — <zj, 


d i tions for the homogeneous case. 

4.5.52. Use the Cramer formulae and 3.1.56. 


5.1.8. Ax=(a, b) x — (a, x) b. 5.1.49. Use 5.1.43. 

5.1.56. Use 5.1.43. 

5.1.58. Match each vector from T A with the plane of its pre-images. 

5.1.60. According to 5.1.59, the subspace T A is isomorphic to the factor-space 
of the space X with respect to the subspace N A . 

5.1.63. Use 5.1.43. 

5.1.65. Let = Ax lt . . ., y h = Ax h be an arbitrary basis for the subspace L. 
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Show that the complete pre-image of L is the direct sum of the subspaces N A and 
L (x,, . . ,,x ft ). 5.2.3. Use 5.1.46. 

5.2.9. The set of all operators mapping an n-dimensional space X to a one¬ 
dimensional space has n dimensions (see 5.2.3). 

5.2.14. Show that if M is an arbitrary subspace complementary to N , then 
the spaces io M y and K N are isomorphic. 

5.2.15. (a) Let e,, ■ ■.,#„ be some basis for X. Given some operator A from 
ujtL. expressions of the vectors Ae lt . . Ae n can be written in terms of the 
subspaces L t and L t : Ae t = u { + v it u t £ L lt v t £ L % . Then A = Ay + A t , 
where Aye, = uy, A,e, — o,, i = 1, . . ., n. 

5.2.16. Use 1.5.16. 5.2.17. Use 5.2.4. 

5.2.18. Prove that T A+B = X. 

5.2.24. It follows from the data that Ax = X^Bx and Ay = X„B„ for any 
nonzero vectors x and y. Show that X, = X u . 

5.2.25. Use 5.2.14. 

5.3.1. (a) Use the relations T BA cz T B and T BA = BT A . 

5.3.2. (a) Use the equality: (BA)X = BT A . 

5.3.3. Use the relations 

r BAC = r AC ~ ^ im ( T AC n N a). r BA = r A ~ < *‘ m ( t a H N fl)- 


5.3.8. Use 5.3.6. 5.3.11. Use 5.3.10. 

5.3.14. If A * = 0, then a = 0. When A* * 0, use 5.2.25. 

5.3.17. Show that the intersection of N P and T p contains only the null 
vector and that PT P = Tp. 

5.3.18. (a) Use 5.3.17. 

5.3.20. The operators E, A, A*, .... A 1 ' 2 are linearly dependent. 

5.3.23. Use 5.3.16, 5.3.15. 5.3.24. Use 5.3.14. 

5.3.29. See 5.2.25. 5.3.33. Use 5.3.30. 

5.3.34. Use 5.2.24. 

5.3.47. If x is a nonzero vector from Na, then / (4) x =/> 0, which is con¬ 
trary to the condition that / (t) is the annihilator. 

5.3.48. If the free term is equal to zero, then a polynomial of a lesser degree 
can be found that also annihilates the given operator. 

5.3.49. Use 5.3.20. 

5.4.8. First evaluate BC. 5.4.9. First evaluate BC. 

■ 5.4.28. Use the theorem staling that any permutation can be factorized into 

the product of transpositions. 

15.4.35. Represent the matrix as = \E + A, where A is a Jordan 
block corresponding to zero; then use the result of Problem 5.4.33. 

5.4.36. (d), (c) For the given diagonal matrix A, construct an interpolation 
polynomial / (t) so that / (d,,) = X. t , i = 1, . . ., n. 

5.4.40. Use 5.4.39. 5.4.49. Use 5.4.33. 5.4.52. Use 5.4.34. 

5.4.56. Use 5.4.23. 

5.4.57. The columns of AB are linear combinations of the columns of A, 
the rows of AB are linear combinations of the rows of B. 

5.4.59. See 4.1.14. 

5.4.69. Partition the matrices A and B into four square blocks of order 2 
and apply the Strassen formulae to these blocks. Use the Strassen algorithm to 
evaluate the products of the blocks. 

5.4.73. (d) Use the multiplication of partitioned matrices. 

5.4.77. (b) See 3.4.41. 

5.5.12. Using the properties of (skew) symmetry about the principal and 
secondary diagonals, only four minors can be evaluated. Use the orthogonality 
of its rows to evaluate the determinant. 

5.5.15. Use the result of Problem 5.5.12. 

5.5.17. For example, use the statement in Problem 5.3.49, according to 
which the inverse matrix A~ l is a polynomial of the matrix A. 


17 0019 
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5.5.18. Use 5.4.49. 5.5.19. Use 5.4.52. 5.5.20. Kind the sum of the elements 
of the i-lh row of the product A~‘A = E in two ways. 

5.5.27. Represent the matrix as a( £4— /„ ) and use 5.3.45. Here J 
is the Jordan block corresponding to zero. 

5.5.28. According to 5.5.18, it suffices to compute the elements of the upper 
row of the inverse matrix only. 

5.5.32. If P is a permutation matrix of the following form 


then PA is an upper triangular matrix. 

5.5.39. Make all the leading principal minors nonzero by interchanging 
rows. 

5.5.46. Show that = nJ„. 

5.5.49. Use 5.5.47. 

5.5.54. Use 5.5.53. 

5.5.56. Use the result of Problem 5.5.51 for the matrix 5.5.55. 

5.5.57. Use 5.5.53. 

5.5.61. Represent the matrix M as the product 


II* 0 mi** A ‘ 1B || 

||c £/ || || 0 D—CA-'B || 


where k is the order of the matrix A, and k + l is the order of matrix M. 
5.5.65. Use 5.4.73, (d). 5.5.66. See 5.5.60. 

5.5.67. Use the formulae of Problem 5.5.62. 

5.5.68. Use the formulae of Problem 5.5.64. 

5.5.69. Use 5.5.65. 

5.5.72. Differentiate the equality A A' 1 = E. 

5.5.77. Use the formula of Problem 5.5.75. 

5.5.79. (d) Use the formula of Problem 5.5.75. 

5.6.12. Use 5.6.9, (c). 5.6.27. Use 5.6.16. 

5.6.29. Consider the operator which the matrix A defines with respect to an 
arbitrary pair of bases for the spaces X and Y. 5.6.30. Use 5.6.29. 

5.6.32. Let 

P- 1 AP = A or AP = PA 


for the matrix A and for any nondegenerate matrix P. Verify that the Schur 
lemma (see 5.4.40) remains valid in the case when A only commutes with all 
nondegenerate matrices. 

5.6.36. Show that the mirror reflection of a matrix in its centre is a similarity 
transformation with the matrix P (see the hint to 5.5.32). 

5.6.37. The equality of the traces of similar matrices can be deduced from 
5.4.22, (c). 

5.6.42. Use 5.6.22. 


6.1.17. The matrix A is a polynomial of the matrix J n of Problem 6.1.16. 
6.1.19. See V. Voyevodin, Theorem 65.1, p. 204. 

6.1.24. Use the test of the direct sum 1.5.18. 

6.1.25. Use 6.1.24 to prove the necessary condition. 

6.1.33. See 5.4.37. 6.1.34. See 5.4.39. 6.1.35. See 5.4.36. 
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6.1.38. Rewrite the condition P~ X AP = A as AP = P A, and write the 
latter with respect to the columns. 

6.1.40. Use the property of the Kronecker product 5.4.73, (c). 

6.1.41. See 5.6.42. 6.1.43. See 5.6.43. 6.2.2. See 3.2.4. 

6.2.3. The rank of the matrix is unity. 

6.2.4. The rank of the matrix equals two. 6.2.7. Use 5.5.77. 

6.2.13. Show that m l (A) — tr (A 1 ). 

6.2.19. Use the matrix of the operator constructed in 5.6.2. 

6.2.20. Use the matrix of the operator constructed in 5.6.3, (a). 

6.2.21. See 6.1.8. 

6.2.41. Consider the matrix of the operator with respect to a basis whose 
first vectors form a basis for the eigensubspace, associated with X. Using this 
matrix, compute the characteristic polynomial of the operator. 

6.2.49. Show that for any eigenvalue X 0 the rank of the matrix X 0 E — C (f (X)) 
equals n — 1. 

6.2.56. The matrix P T is the companion of the polynomial / (X) = X" — 1. 

6.2.60. Use the matrix equality 


||XE m -4B A 
II 0 XE„ 


E m 

B 


XE m A III 
0 XE„-B4|p 


6.2.61. Use the matrix equality 


II £ E || || X £—A -B 
|| 0 e|||| —B XE—4 


0 

X£— (A — B) 


| £ £ || 
|0 £ ||' 


6.2.64. Use the matrix equality 


X £—B C | 

— C X£— B | 


XE—.4 0 _ 

-C X£-4 


A = B + iC, A = B - 1C. 


6.3.5. See 6.1.25. 

6.3.6. Any subspace of dimension k — 1 can be represented as the inter¬ 
section of two subspaces of dimension k. Thereby, any subspace of dimension 
k — 1 is also ,4-invariant. 

6.3.9. Use 6.3.3 for the operator A — X 0 E where X 0 is an eigenvalue of 4. 

6.3.21. Use 6.3.18, (a). 

6.3.26. Use 6.3.14 and 6.3.25. 6.3.27. Use 6.3.14. 

6.3.28. If n is the dimension of the space, then there are not more than n * 
linearly independent operators; therefore, it suffices to prove the statement for 
a finite number of commuting operators, e.g., by induction over this number. 

6.3.30. In each pair of invariant subspaces with respect to the differential 
operator, one is contained in the other. 

6.3.32. Let all roots of the characteristic polynomial of the operator 4 be 
complex; each is an eigenvalue of the corresponding operator 4. Show that if X 
is an arbitrary eigenvalue of 4 and z = x + ly is an eigenvector associated with 
X, then the subspace drawn on the real vectors x and y has 2 dimensions and is 
4-invariant. 

6.3.36. Use 6.3.9. 6.3.38. Use 6.3.19. 


6.3.42. Show that for each eigenvalue of X,,. . ., X„,, the defect of the matrix 
B — Xj£ equals k t . 

6.3.46. Repeat the construction performed In Problem 6.3.38, taking into 
account Problem 6.3.32. 


6.4.1. Prove that for the number a, mentioned in 5.3.10, the subspaces N„ 
and T q intersect in the null vector only. 


17* 



6.4.2. Let X = N + T be the decomposition derived in 6.4.1, where N 
is the kernel and T is the image of the operator A*. If X = A'i + T x is any 
other decomposition such that AlN x is nilpolent and AlT x is nondegenerate, then 
show that N x cJV, T x a T. 

6.4.3. The characteristic polynomial of the operator A equals the product 
of the characteristic polynomials of the operators A/N and A/T. 

6.4.4. Apply 0.4.1 to the operator A — K X E and show that in the decompo¬ 
sition X = N x + T x , the subspace A’, possesses all the properties required for 

Then, decompose the subspace T x emanating from the operator A — X t E, 
etc. 

6.4.3. Use 6.4.2 and 6.3.43. 6.4.9. See 6.3.50. 

6.4.10. Use the decomposition (6.4.2). 6.4.11. Use G.4.10. 

6.4.14. Use 6.2.61 to find the eigenvalues of the matrix. 

6.4.37. Contrast with 6.3.17. 6.4.38. Use 6.4.17, (e), and 6.4.37. 

6.4.41. Select linearly independent vectors x u .... x p so that their span 
in the direct sum with H t . x produces the whole space X. 

to &.4.56 t£e sequence of numbers p,, . . ., p t is nonde¬ 
creasing. 

6.4.62. The matrix is reduced to quasi-diagonal form by the same transfor¬ 
mations of the columns and rows. 

6.4.72. Use 6.4.18. 6.4.75. Use 6.4.34, 6.4.48, 6.4.55. 

6.4.76. Use the Jordan form of the operator. 

6.4.80. Square the matrix / — X t E and calculate the increase in the defect; 
multiply the matrix (/ — X 0 E)* by / — \ 0 E and calculate the increase in the 
defect again, etc. 

6.4.86. Note that for the matrix 



the equality B 3 = 0 holds. When raising the matrix A — E to a power, remember 
that the matrix is quasi-triangular. 

6.4.87. See the hint for 6.4.86. 6.4.88. The defect of the operator equals 
unity. 

6.4.91. Verify the equality of the ranks and traces of the matrices A, B 
and C. 

6.4.98. Use 6.4.39. 

6.4.100. Let A = PAP- 1 , where A is a diagonal matrix. Then the matrix 
A X B is similar to the matrix A X /, and A X E n + E m X B is similar to 
A X E n + E m X J. 

6.4.102. Use 6.4.32. 

7.1.9.\Consider the matrix of the operator in Cartesian coordinate system. 

7.1.12. Note that the basis (b) mentioned in Problem 7.1.11 is orthonormal 
with respect to the scalar product defined in (7.1.2). 

7.1.13. Note that the basis (b) mentioned in Problem 7.1.11 is orthogonal 
with respect to the scalar product defined in (7.1.3), and use the result of 7.1.6. 

7.1.22. Use 6.4.77. 

7.1.23. Use the correspondence between the conjugate operators and con¬ 
jugate matrices. 

7.1.34. Use the result of Problem 6.3.17. 

7.1.40. Use the existence of a common eigenvector of commuting operators 
A* and B*, and therefore, of a common invariant subspace of dimension n — 1 
to the operators A and B. Here n is the dimension of the space. 


6.4.49. (d) m._ x - 
6.4.57. According 
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7.1.41. Use theSchur theorem. 7.1.45. Use 7.1.7. 7.2.8. See 7.1.10. 7.2.9. Con¬ 
struct the matrices lor the operators with respect to the orthonormal basis 
1, 1, 1*.l n . 

7.2.10. Use 5.4.52. 7.2.14. Use 7.1.16. 7.2.16. Use 7.1.15. 

7.2.19. Show that M A = N A ». 

7.2.20. Deduce from the indicated data that the root subspaces of the oper. 
ator A coincide with its eigensubspaces, and that they are mutually orthogonal. 

7.2.23. Use 7.2.18. 

7.2.24. Prove the existence of an orthonormal basis containing they eigen¬ 
vectors of the operator A following the procedure for the construction of the 
Schur basis. 

7.2.25. Use 6.3.25. Use 7.2.13 for another possible solution. 

7.2.26. Use 7.2.25. 

7.2.32. The given matrix differs from a real one by an addend — iE. 

7.2.36. Define a scalar product using the eigenvector basis of the operator A. 

7.2.38. To prove the necessary condition, construct an interpolation poly¬ 
nomial /_(X) so that for each eigenvalue }. t of the operator A, the condition 
/ (Xj) = X< may be fulfilled. 

7.2.40. See 7.1.40. 

7.2.47. Use the decomposition of vector x in terms of the orthonormal eigen¬ 
vector basis of the operator A. 

7.2.48. Use 7.2.47 for the vector *=(111... 1) T . 

7.2.50. To prove the latter statement, show that a basis can be selected that 
consists of “real vectors", i.e. vectors of the form * + 10 for the eigensubspace of 
the operator A associated with an eigenvalue X. 

7.3.9. Consider the operator matrix with respect to the orthonormal[eigen- 
vector basis and remember that a circumference can be drawn through the points 
Xj, X., X. on the complex plane. 

7.3.13. Verify that A* = E. 

7.3.16. The effect of the operator in the polynomial 1—21+ l 9 , which is 
orthogonal to the two given polynomials 1 + 1 + t* and 1 — l 9 may be deter¬ 
mined by the data given. Construct the matrix of the operator Q with respect 
to the basis formed by these polynomials, and then transform it to the required 
basis 1, 1, t 9 . 

. 7.3.18. See 7.3.19. 

7.3.20. Use the relation (*, y)= ~ ^ for the real case and 

(*, y) — ———-—— ^ +n j + *yl ~ 1 I r —f or t h e complex case. 

7.3.39. Consider a sequence of matrices T ltf T Ia , . . ., T ln whose parameters 
are selected in accordance with 7.3.38. 

7.4.8. Assume the vectors * and y to be a basis for the space. 

7.4.10. A skew-symmetric operator on the three-dimensional space is de¬ 
generate. Consider the matrix of the operator K with respect to an orthonormal 
basis, one of whose vectors belongs to the kernel of K. 

7.4.11. Verify that (x t , y,) = (y t , xj) when i =£ 

7.4.15. Find a polynomial /, (t), orthogonal to the given polynomials/ t (1) = 
= 2 + 21 — 1* and / s (1) = 2 — 1 + 2t* and having the same length. The 
matrix of the operator 5 with respect to the orthogonal basis / t (1), / 2 (1), /, (1) 
can be determined from the data of the problem. Then transform the matrix to 
the required basis 1, 1, t*. 

7.4.27. Consider the matrix of the operator A with respect to the orthonormal 

eigenvector basis. Draw a straight line through the eigenvalues X„ 

on the complex plane. 

7.4.32. According to 7.4.30, the t-th column e t is the eigenvector associated 
with the eigenvalue Xj. 
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7.4.41. Show that the eigenvalues of an irreducible Hermitian matrix can¬ 
not be multiple. 

7.4.43. (a) A common root of the polynomials / t +, (X) aud ) ( (X) is also a 
root of the polynomial / ( _ 1 (X), etc. But the polynomial / 0 (X) = 1 has no roots; 
(b) use (a) and 7.4.35; (c) use iterative formulae. 

7.4.48. To find the sequence (7.4.8), employ the iterative formulae con¬ 
necting the polynomials f t (X). 

7.4.51. Show that the matrix A is similar to a tridiagonal irreducible Her¬ 
mitian matrix. 

7.4.52. Use 7.2.50 to prove (b). 

7.5.9. Without loss of generality, the principal submatrix of order k under 
consideration can be assumed to lie in the left-hand upper corner of the given 
matrix H. Then the scalar product (//x, x) for the column vectors, in which only 
the first k components can be different from zero, should be considered. 

7.5.10. Let G be the Gram matrix, x = (a lt _. . ., a*) 7 an arbitrary A:-dimen¬ 
sional column vector. Show that (Gx, x) = | a jXj + . . . + a k x h |. 

7.5.16. (a) Use the decomposition of the vector x in terms of the eigen¬ 
vectors of the operator H. 

7.5.23. Use 7.5.22. 7.5.24. Use the test 7.5.18. 

7.5.25. Use 7.4.53. 

7.5.27. Consider the associated matrix H h . 

7.5.29. Show that the Schur product of the matrices Il x and H t is the prin¬ 
cipal submatrix of the Kronecker product Hi X H t . 

7.5.32. Use 7.4.38. 

7.5.33. Use the decomposition in terms of the eigenvectors of the operator H. 

7.5.34. (a) Use 7.5.23; (b) use 7.5.32. 

7.5.36. To prove the sufficient condition, use 7.4.35. 

7.5.41. Use 7.5.24. 7.5.43. Use 7.5.30. 

7.5.44. Use the Sylvester criterion. 

7.5.45. See V. Voyevodin, p. 261. 7.5.49. H* = 4 H. 

7.5.50. Use Hadamard’s inequality (see 3.3.3) for the square root of the 
matrix H. 

7.5.51. Use 3.3.25. 7.5.55. Use 7.5.52. 

7.5.56. Show that the operator HS has the same eigenvalues as the Hermitian 
operator S l l t HS l l t . 

7.5.62. See V. Voyevodin, Sec. 78. 

7.6.8. Consider the matrices of the differential operator and its conjugate 
with respect to the orthonormal basis 1, t, t 2 , . . ., t n . 

7.6.9. To evaluate the singular values, use the matrix of the conjugate 
operator obtained in 7.1.12, with respect to the basis 1, 1, <*. 

7.6.10. Let X and Y be arbitrary Euclidean (unitary) spaces of dimensions n 
and m, respectively. Consider the operator generated by the matrix A with 
respect to an arbitrary pair of bases for the spaces X and Y, and use the singular 
bases of this operator. 

7.6.17. If A = UAV is the singular-value decomposition of the matrix A, 
then U* and V * are convenient matrices. 

7.6.26. Use 6.3.51. 7.6.27. Use 7.6.26. 

7.6.29. Using 7.6.28, prove that in the Schur form for the operator A, all 
the off-diagonal elements of the row and column, in whose intersection X] lies, 
equal zero. 

7.6.30. Using 7.6.29, prove the existence of a basis of the eigenvectors com¬ 
mon to the operators A and A*. 

7.6.33. The proof is similar to that of 7.4.38. 

7.6.39. The columns of the matrix are orthogonal. 

7.6.40. The rank of the matrix equals unity. 7.6.42. Use 7.6.20. 

7.6.43. The matrix is symmetric. 

7.6.45. Verify that the matrix to the accuracy of the numerical factor 2 
is unitary. 
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7.6.46. Use 7.6.36. 7.6.50. See the solution of 7.6.49. 

7.6.51. Use the equality A/T a * = (1IIT a ) ( UlT A *) or ( H/T A )~ 1 X (4/7» 
= MT a *. 

7.6.62. Use 7.6.59. 7.7.2. Use 7.4.24. 

7.7.8. Use 7.4.16. 

7.7.13. Use an orthonormal basis of the eigenvectors, common to the com¬ 
muting normal operators (sec 7.2.40). 

7.7.17. (b) .4/7is siinilarto the matrix//UM// 1 / 2 = //W/,// 1 /* + Iff 1 /*//,// 1 /*. 

7.7.18. Perform a similar transformation A = DAD- 1 , where D is a diago¬ 
nal matrix with positive diago nal elem ents selected so that for the matrix A 

the equality is valid a t l+l = —a t+l t , i = 1, 2, . . ., n — 1. Then use the 
Bendixson theorem (see 7.7.15). 

7.7.19. Use the Bendixson theorem. 

7.7.20. Consider the equality Alii 1 = E - f iH.Hz 1 and show that 
I det (All- 1 ) | > 1. 

7.7.21. Consider the Hcrnntian decomposition of the operator A with respect 
to the Schur basis and use 7.5.50. 

7.8.8. Use 7.5.62. 

7.8.11. The vector b = (1 1 1) T is orthogonal to T A . 

7.8.15. The matrix of the system is nonnegative. 

7.8.18. The system splits into two, in x,, x. and in x % , x 3 , x s . 

7.8.22. Use 7.8.5. 7.8.23. Use 7.8.6. 7.8.32. Use 7.8.7. 

7.8.37. Use 7.1.32 and 7.8.26. 

7.8.38. It follows from the data that T BA = T„, N BA = N A . To prove 
the required relation, use 7.8.26. 

7.8.39. Show that the effect of both operators on the vectors of the singular 
basis is the same. 

7.8.42. (a), (b). Use 7.8.41; (c) first show that the operator X has the same 
image and kernel as the operator/!*, and then deduce from the equation A *A X = 
— A* that the effect of X on the two subspaces T A and T A * is inverse to the 
effect of the operator A. 

7.8.43. Use 7.8.42, (a). 

7.9.6. The proof is given in the same way as the law of inertia. 

7.9.11. Use the law of inertia. 

7.9.14. Note that in transforming from to D h +,, the number of coin¬ 
cidences and changes of sign increases by one each, irrespective of the sign 
ascribed to D k . Moreover, the number of positive and the number of negative 
eigenvalues of the submatrix A k +i each is one greater than the corresponding 
number for the submatrix 4»_i. 

7.9.39. See 7.9.40. 7.9.40. Use 5.6.36. 

7.9.42. Show that the roots of a z-equation are unaltered in a nondegenerate 
transformation of both forms. 

7.9.44. Use 7.2.40. 

7.9.50. Let A and B be the matrices of the quadratic forms F and G, and 
let B = S T S be the triangular decomposition of the matrix B. The roots of the 
z-equation | A — zB | = 0 are the eigenvalues of the symmetric matrix 
(5- , )’ r .1 S- 1 . Hence, 7.4.30 can be used. 

8.1.2. (d) Use the Minkowski inequality. 

8.1.20. Show that all the subsequences have the same limit a and that a 
is the limit of the whole sequence. 

8.1.22. Use 8.1.21. 

8.1.23. For a fixed basis for the space, the coordinates of all the vectors of 
the given sequence are bounded. 
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8.1.32. Use the equivalence of the convergence, with respect to any norm, 
to the coordinate convergence. 

8.1.35. Consider the values of each norm on the unit ball determined by 
another norm. 

8.1.38. Use 8.1.35. 8.1.50. Use 8.1.49. 

8.2.6. Prove the statement (b) for the subordinate operator norm, and then 
use the equivalence of the norms. 

8.2.18. Use 7.1.17. 8.2.21. (b), (c). Use 7.6.34. 

8.2.22. Use the relations 

H X = ±-(A + A*), M'-i-iA-A*). 

8.2.27. Use 7.6.64 and 7.6.34. 

8.2.28. Show that for a positive semidefinite matrix A: S (A) = trA. 

8.2.29. Use 8.1.34. 8.2.37. Use 8.2.34. 

8.2.39. Use the representation of the subordinate norm from 8.2.38. 

8.2.41. Put for the given norm M (A), m (z) = M (X) where X is a matrix 

with z as the first column, and whose other columns are zero. Show that m (z) 
is a norm on the arithmetic space and that M (A) is consistent with m (z). 

8.2.44. Use 8.2.42 and 8.2.39. 

8.2.46. Use 8.2.45. 

8.3.3. Use 8.3.2. 

8.3.5. Use 7.6.33. 

8.3.6. Use 3.3.32 and 8.3.5. 

8.3.7. Use 7.6.33. The solution is similar to that of 8.3.5. 

8.3.8. Represent A as A = D (E + D~ X B), where D is a diagonal matrix 
made up of the diagonal elements of A. 

8.3.10. Apply the test of Problem 8.3.9 to the transpose A T . 

8.3.11. See the hint for 8.3.8. 

8.3.25. Verify that | det A | = 1. Therefore (see 8.3.24) an increase in the 
condition number is only possible when the norm of the matrix increases. Show 
that matrices with a large Euclidean norm fulfilling the conditions of the 
problem possess a smaller condition number. 

8.3.27. Use the expression cond, (A + a E) in terms of the eigenvalues of 
the matrix A. 

8.3.28. See 7.4.35. 

8.3.30. To estimate the condition number, use the inequalities of Problem 

7.6.28. If the first row of the system is multiplied by 10* 1 , second by 10, and 

third by 100, then the matrix of the derived system will be symmetric. 

8.3.35. Show that the solution of the system D (z) = b may be taken as 
an approximation to the exact solution of the given system, where 

112.5 0 0 Oil II 51| 

I 0 -3 0 0 I 3 

|0 0 5 0’ ~ 10 ’ 

II0 o 0 4 II II 4 II 

8.3.36. Show that the solution of the system Bx = b may be taken as an 
approximation to the exact solution of the given system, where 

| 0.5 —0.5 0 01| || 0.5 

0.5 0.5 0 0 0.5 

- l 0 0 3 -2 ' | 0 

| 0 0—2 l|| || 0 
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8.3.37. Use the identity B- 1 — A- 1 = A- 1 (A — B) B~ l . 

8.4.1. See 8.2.41, and also V. Voyevodin, p. 275. 

8.4.4. Prove that the matrix is positive definite. 

8.4.7. Apply 8.4.1 to the companion matrix of the polynomial f (z)/a„. 
8.4.9. Use 6.4.102. 8.4.12. Use the Schur theorem. 8.4.15. Use 6.4.102. 
8.4.17. Use the Schur inequality and the statement 8.4.14. 

8.4.23. Consider the given matrix as a perturbation of the matrix 

IKl- 

8.4.25. Use the inequalities of Problem 7.4.38. 

8.4.27. The given matrix is similar to the symmetric matrix 

j| 2-10-* — 3-10-* 4-10- 4 0.9991 | 

—3-10"* I-10 -4 —0.4993 -6.10-* I 

4.IO- 4 —0.4993 2 10- 4 — 2-10" 4 ’ 

|| 0.9991 — 61<H —2-10" 4 1-10- 4 | 

which can be considered as a perturbation of a symmetric matrix B such that 
= 6 4 i = 1, 6„ = 632 = —0.5, and the other elements b tt equal zero. 

8.4.28. Use the inequalities of Problem 7.4.38. 

8.4.29. Consider the given matrix as a perturbation of a symmetric matrix B 
such that b n =6 tl =l, 6„ = 6„ = —2, 6 S4 = 6 t , = —1 and the other 
elements b tj are zeroes. 

8.4.30. Use 7.4.38. 8.4.33. See 7.6.23. 

8.4.34. From the normality of the matrix A, the normality of A — \iE fol¬ 
lows. 

8.4.35. (a) On the orthogonal complement to the vector e u the moduli of 
the eigenvalues of the normal matrix A — \i 0 E are not less than a; (b) use the 
condition II Ax — a B x II. = e; (d) use the Cauchy-Buniakowski inequality. 

8.4.37. See 8.4.34. 

8.4.39. (c) Use the estimate (8.4.6). 

8.4.40. Use the Schur theorem. 8.4.41. Use the Schur theorem. 


8.4.46. Add the matrix A n _! = ^_| c |* SC t0 ^ n_I aD< ^ estimate II A n-i ll»* 

8.4.47. This statement may be derived from 8.4.46 in the same way 8.4.44 
is derived Irom 8.4.43. 
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► 1.1.2. Yes, if the straight line passes through the point 0 ; otherwise no. 
1.1.3. No. 1.1.4. No. 

1.1.7. No. 1.1.8. Yes. 

1 . 1 . 10 . 2 *. 

1.1.11. Yes. 1.1.12. Yes. 

1.1.13. Yes. 1.1.14. Yes. 1.1.15. No. 

1.1.16. (a) No; (b), (c), (d) yes. 

1.1.17. Let G be an abelian group under addition containing more than one 
«lement. Fix some field P, and for any x 6 G and any \ 6 P. set kr = 0. 

Thus, the use of this axiom 1 -r = x means that by multiplying vectors of 
the given space by arbitrary numbers every vector could be obtained. 

1.2.9. (a) Yes; (b) yes; (c) no. 

1.2.11. The set is linearly independent. 

1.2.12. The set is linearly dependent. 

1.2.13. 5( 3 — 5<* — 4t + 6 in both cases. The set is linearly dependent. 

1.2.18. Let be an arbitrary set of vectors of the arithmetic space. 

Set up the coordinate matrix of these vectors 


IIP.. Pi. ••• P,»|| 

P.i Pts ••• PJI 

ll P«1 P«2 Psfc ll 

Let m be the first column in the matrix with nonzero numbers. By interchanging 
the rows of the matrix, which corresponds to interchanging the vectors of the 
set, we can make p 1/n =£ 0. Subtracting the appropriate multiples of the first 
row from all the following rows zeroes can be obtained at every place in the 
m-th column except the first. These row transformations are obviously equiva¬ 
lent to a sequence of elementary transformations of type (c) over the vector 
set r,, . . ., x,. Considering now all the rows of the matrix except the first, 
repeat the procedure, etc. 

1.2.19. The set is linearly independent. 1.2.20. The set is linearly depen¬ 
dent. 1.2.21. The set is linearly independent. 1.2.22. The set is linearly depen¬ 
dent. 1.2.23. The set is linearly dependent. 1.2.24. The set is linearly indepen¬ 
dent. 1.2.25. The set is linearly independent. 1.2.26. The set is linearly indepen¬ 
dent. 1.2.27. The set is linearly independent. 

1.3.1. All vectors of the form (a, 0, p, 0, y). 1.3.2. All vectors of the form 
(a, p, v> P. a). 1.3.3. All vectors (a,, a 2 , a 3 , a 4 , a 5 ) satisfying the condition 


2 a i = °- 


1.3.4. All polynomials of degree <2 and the null polynomial. 1.3.5. The 
same answer as to 1.3.4. 1.3.6. All polynomials of degree <2, in which the coef¬ 
ficient sum equals zero, and the null polynomial. 1.3.7. The same as in 1.3.6. 
1.3.8. No. 


1.3.28. 2. 1.3.29. 2. 1.3.30. 


= 2x l — 10x* + 8ar s . 

I. 4. 1.3.31. 3. 1.3.32. 3. 


4. 
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1.3.35. For example, x x , x 3 . 1.3.36. For example, x x , x t , x 4 . 1.3.37. For 
example, x x , x., x 4 . 1.3.38. For example, x x , x 9 . 

1.3.40. (a) Precisely r vectors of the set are different from zero; (b) r + 1 
vectors of .he set are different from zero, two of them being coll inear; (c) either 
r+ 2 \eclors of the set are different from zero, three of them being collinear, 
or r + 1 vectors of the set are nonzero and there exist three linearly dependent 
vectors, two of which are not collinear. 

1.3.41. x x , x t ; i\ , x 4 ; x s , x 3 ; x 3 , x 4 . 

1.3.42. Any two vectors. 1.3.43. x x , x s ; x t , x 3 ; x t , x 4 . 

1.3.45. Yes. 1.3.46. Yes. 

1.4.1. The space is one-dimensional, its basis being any number other than 
one. 1.4.2. The dimension of the space equals k. 1.4.3. The space is infinite- 
dimensional. 1.4.4. The dimension of the space equals 2. 1.4.5. The space is 
infinite-dimensional. 1.4.6. The dimension of the space equals n + 1. 

1.4.7. (a) 1; (b) 2. 1.4.8. (a) n; (b) 2n. 

1.4.13. The basis is the set (b). 

1.4.21. The base can be made up, for example, of the 1st, 3rd and 4th poly¬ 
nomials. 1.4.22. The base can be made up, for example, of the 1st and 2nd poly¬ 
nomials. 

1.4.23. 1/3, 1/3, 1/3. 1.4.24. 0, -5.4. 1.4.25. 0, 2, 1, 2. 1.4.26. 67, -51, 
-3, 11. 

1.4.27. (a) 1, -1, -1, 1, -1, 1; (b) 2, -1, -1, I, -1, 1; (c)l, -1, -1, 2, 

1.4! 28. e = c, - e*. 

1.4.35. x., x,, x s , x 4 . 1.4.36. For example, x., x,, x 8 . 

1.4.37. Tne dimension of L equals n — 1. 

1.4.38. (a), (b), (c) b; (d) n - 1. 

1.4.39. The basis can be made up, for example, of the 1st, 2nd and 3rd 
polynomials. 

1.4.43. No. 1.5.2. No. 1.5.3. No. 

1.5.7. L t c= L v The vectors x,, x lt x 3 are linearly independent. 1.5.8. The 
basis for the sum can be made up, for example, of the vectors x x , x s , x 3 , y x . The 
dimension of the intersection is 2. 

1.5.10. The basis for the sum can be made up, for example, of the vectors 
Xi, xj, iji- The basis for the intersection is the vector z = (3, 5, 7). 

1.5.11. The basis for the sura can be made up, for example, of the vectors 
x x , x 4 , x 3 , y x ; the basis of the intersection, for example, of z, = (1, —1, 1, —1), 
z. = (2, 0, 2, 0). 1.5.12. The basis for the sum could be, for example, x,, x,, x 3 , y t . 
The basis for the intersection could be, for example, zj = (0, 4, 1, 3), z s = 
= (2, 0, 1, -1). 

1.5.20. x = (-1, -2, -6, -3) + (3, 2, 6, 6). 

1.5.23. The subspace L is two-dimensional. As the complementary subspace, 
for example, the spans of the vectors e x = (1, 0, 0, 0), e t = (0, 1, 0, 0) and e 3 = 
= (0, 0, 1, 0), e 4 = (0, 0, 0, 1) can be taken. 

1.5.24. For example, the set of polynomials of the form e-t n . 

2.1.5. A change in the scale unit for measuring lengths. 

2.1.7. (a) -1; (b) 4; (c) 0. 

2.1.11. Yes, if a = 0; no, when a =£ 0. 

2.1.14. 0. 2.1.19. No. 

2.2.5. y, = x x = (1,-2, 2),|i/ 3 = ( — -1), y 3 = (6, -3, -6). 

2.2.6. yi = x, = (1, 1, 1, 1), y t = (2, 2, -2, -2), y 3 = (-1, 1, -1, 1). 

2.2.10. For example, add the vectors x 3 = (1, 1,1,0) and x 4 = (—1, 1, 0, 1)- 

2.2.11. For example, add the vectors x 3 = (2, 3,1,0) and x 4 = (1, —1, 1, 1). 

2.2.12. Add, for example, the vector x 3 = (2/3, —1/3, 2/3). 
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2.2.13. Add, for example, the vector x. = (1/2, 1/2, 1/2, 1/2 , x. = 

= (1/2, 1/2, -1/2, -1/2). 

2.2.16. n — 1, where n is the dimension of the given Euclidean space. 

2.2.17. (a) ( x,y) = XJajB. + X-a.p, + . . . + X*a n p n ; 

(b) (x, y) = (W! + «iP. + a.h> + (a,P, + «,P, + • • • + OnP,,)- 

Here 04, . . ., a„ and pj, . . ., p n are the coordinates of the vectors x and y with 
respect to the corresponding bases. 

2.2.19. y 2 = x x = (2, 3, -4, —6), y t = (-3, 2, 6, -4), y 3 = (4, 6, 2, 3). 

2.2.20. y x = x x = (1, 1, -1, —2), y t = (2, 5, 1, 3), y, = (2, -1, 1, 0). 
2.2.22. Let n > 3. Compile by row the coordinate matrix of the vectors 

e u . . ., e n . Note that if the signs of all elements of an arbitrary column of this 
matrix are changed, then its rows produce the coordinates of a new and still 
orthogonal set of vectors. We shall assume, therefore, that the first row of the 
matrix consists of units only, and that in the first three row's, the columns of 
only one of the following forms are possible 


1111 
1 1 - 1—1 
1-1 1-1 


Denote the number of columns of each of the indicated forms by x, y, 2, w, 
respectively. Then, obviously, 

x+y+ 2+u> = n. 

It follows from the orthogonality of the first three vectors that 
x + y — 2 — u> = 0, 
x — y + 2 — to = 0, 
x — y — 2+to = 0. 

We obtain from this system that x~y=z = u> = n/4. Thus, n must be a 
multiple of 4. 

2.2.26. If / (<) = a, + a t t + + . . . + a„r», g (t) = 6 0 + V + b t t > + 

+ . . . + b n t n , then 

(/, g) = «o&o + Vi + (2!)* a,b t + ... + ("D» a n b n . 

2.3.6. For example, y, = (—3, 1, —2, 0), y t = (1, —1, —2, 1). 

2.3.8. (a) The subspace of polynomials of dimension one all of whose 
coefficients are equal; (b) the subspace of all odd polynomials. 

2.3.9. For example, 

304 — a 2 + 2a 3 = 0 
04 — a 2 — 2a s + a 4 = 0 

for the subspace L, and 

a 2 -f- 3a t + 2a 4 = 0 
304 + 7a, — a 9 + 2a 4 = 0 
for its orthogonal complement. 

2.3.10. Let L be the span of the vector set a,, . . ., a k , not necessarily linear¬ 
ly independent. The required vector y can be represented as a linear combination 
y = ajoj + . . . + cc h a A . Since (2, a,) = 0, 1 = 1, . . ., k, to determine the 
coefficients a,, . . ., a h the following system of linear equations can be formed 

(«|. fll)<*l + (<'2. °l) a 2+ - • • +(Oh> Ol)a*=(*. 0|). 


(a,, a h )a I -i-(a ;l , a h ) a 2 + ... + (a h , a h )a h =(x , a h ). 
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To conslruct the vector y, any solution of the system can be used. The vector z 
is determined as the difference x — y. 

2.3.11. If the set x lt . . x h is linearly independent. 

2.3.12. y = (5, 2, -9, -8), z = (9, -5, 3, 1). 

2.3.13. y = (0, -3, 5, 2), z = (2, -2, -2, 2). 

2.3.14. y = (1, 2, -5. 1), z = (-4, -2, 0. 8). 

2.3.16. Suppose c lt . . ., <?„ is the given, and /,, ...,/„ is the required, bi- 

orthogonal basis. The conditions 

(c„ fj) = 0, i = 1./ - 1, / + 1.. 

stipulate that the vector fj should belong to the orthogonal complement of the 
span of the vectors e lt . . ., ej. f , ej+„ . . ., e n . In this one-dimensional subspace, 
the condition ( ej , fj) = 1 uniquely determines the vector fj. 

0 , 0, 0>. /.= (0.4. 0. 0). 0, ^.o), 

/.= (0, 0. o,4). 

2.3.19. /, = (1, 0, 0, 0), /- = (0, 1, 0, 0), / 3 = (-1, -2, 1, -3), f. = 
= (0, 0, 0, 1). 

_ 2.3.20. /, = (1, 0, 0, 0), /, = (-1, 1, 0, 0), /, = (0, -1, 1, 0), / 4 = 

'L°;." / !', , (4,4,4.4) > 

, _ I i ii l \ . / l l i i \ 

/s -\T’“T’T >~T)' = 

2.4.2. (a) It remains unaltered; (b) it is reduced to the supplementary angle 
(up to n)\ (c) it remains unaltered. __ 

2.4.4. | * | = 3 \f 2, | y | = 6, \ x — j/ | = 3 |/ 2. Thus, the triangle is 

^ ji 

isosceles, x, (x — y) = —, hence, the triangle is right-angled, x, y = and is 

. an interior angle of the triangle, y, (x — y) = ^ and, hence, an interior angle 

of the triangle is the angle, y, (y — *). 

2.4.6. (a) | / |* = 10, | g |* = 9, | / - g |* = 3, | / |* < | g |* + | / - g |*. 
and, hence, the triangle is acute-angled; (b) | / |* = 19, | g |* = 13, | / — g |* = 
= 4; I / | a > I g l a + I / — g I*, and the triangle is obtuse-angled. 

2.4.10. For a parallelogram, the conditions for the equality of the lengths 
of the sides and for the perpendicularity of the diagonals are equivalent. 

2.4.14. (a) i* + 3/ + 3; (b) 3; (c) (3 + mi + . . . + 

2.4.18. (a) 1; (b) 1; (c) a. 

2.4.24. J- 2.4.25. J. 

2.5.8. The equality | x — y |* = I x |*+ I y I* means that the scalar prod¬ 
uct of the vectors x and y is a purely imaginary number. 

2.5.10. From the equality of the lengths of the vectors x and y, it does not 
follow that the vectors x + y and x — y are orthogonal. 

2.5.15. The complex arithmetic space C n . 

2.5.19. The vector (—Pi, • • P„. <*i, • • •, <*n) corresponds to the vector it. 

The natural scalar product (2.2.1) is induced on J? 2n . 

3.1.1. The term is positive. 3.1.2. It is not a term of the determinant. 
3.1.3. The term has a minus sign. 3.1.4. It is not a term of the determinant. 
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3.1.5. (a) a 13 a I4 a3 S a 4t a S7 a tl a- 2 ; (b) a la a 24 a 36 a 4t a 5 , a 4t a ;1 . 

3.1.6. (a) i = r, (b) * <;; (c) t >]■ 

3.1.7. The plus sign. 

3.1.8. . . . a nn . 

3.1.9. (a) i + ; = n + 1; (b) i + , < n + U (c) i + , > n + 1. 

3.1.10. The sign is (—l)"!"- 1 */ 2 . 

3.1.11. (—l) n ( n - I >/ 2 .a ln a 2 , ... «„,. 

3.1.12. (-1)"- 1 . 3.1.13. (-l)<"- 2 )(" »)/ 2 . 3.1.14. 1. 3.1.15. 1. 
3.1.17. 0. 3.1.18. 0. 3.1.19. 16. 

3.1.21. n. 

3.1.22. If we put 



then the number of nonzero terms in a determinant of order n of the indicated 
form equals 

r>-l _n , 1 — r l 


3.1.23. 2"-». 

3.1.24. (-1)" (<" - ajOj . . . «„). 

3.1.25. t n + «nl n_1 "i" a n-l* n-2 + • • • + 

3.1.26. n. 3.1.27. n. 

3.1.29. The determinant 

5,i b lt ... 6, n 

5*, 5 tt ... 6 2 « 


5».i bnt b n 

must be equal to zero. 

3.1.30. The free term is then determinant 




3.1.31. The determinant obtained is a complex number, conjugate to the 
original determinant. 

3.1.32. The determinant is multiplied by (—1)". 3.1.33. The determinant 
is multiplied by a n . 3.1.34. The determinant is unaltered. 

3.1.38. The determinant is multiplied by (—l) n < n - 1 )/*. The element 
a n +i-i j of the original determinant is at ((, j) in the obtained determinant. 


3.1.40. The determinant is unaltered. 


3.1.41. a n+ ,_y 

3.1.42. The determinant is unaltered. 

3.1.43. The determinant is multiplied by (—l) n ( n - 1 )/*. 

3.1.44. The roots of the equation are the numbers —2, —1, 1, 2. 

3.1.45. The roots of the equation are the numbers 0 and —1. 

3.1.46. when n = 1, 0 when n > 1. 3.1.47. 1 when n = 1, — 2 when 
n= 2,0 when n > 2. 

3.1.48. The polynomials /, ((), (f) are linearly dependent. Let, for 

definiteness, f n (tl = a,/, (!)+... + «n-i/ n -i (0- Then, for any number a, 
tn (a) = o,/, («) + ... + «n-i/ n -i (<*)• Therefore, the rows of the indicated 
determinant are linearly dependent. 
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3.1.49. (a) The determinant is unaltered; (b) the determinant becomes zero. 
3.1.51. 1 + ijt/j when n = 1, (j- 2 — *i) (y t — !/i) when n = 2, 0 when 


when n = 1, sin (aj — a 2 ) sin (| 


n > 2. 

3.1.32. cos (a, - (I,) 

= 2, 0 when n > 2. 

3.1.53. 1 + x,j h + i 2 iij + ■ ■ • + x n y„. 

3.1.54. 1 - 2 (uif + + . . . + Wn) = —1. 

3.1.57. The permanent of the matrix 

/1 n 


equals two even though its rows are linearly dependent. However/the perma¬ 
nent of the matrix 

1 -1 


with linearly independent rows equals 0. 

3.2.1. ( a) n C k ; (b) ("t'*)*. 3.2.3. "C ft . 

3.2.4. Let Pi be the sum of all the principal minors of order 1 of the deter¬ 
minant 

II"ii a i* | 

a il a . . » 


l|«ni «B2 ... a nn II 

Then / (0 = /" + Pl t »-» + . . . + P „. 1 t + Pn . 

3.2.5. k + 1. 

3.2.8. If D is of odd order, then D' is symmetric; if D is of even order, then 
D' is skew-symmetric. 

3.2.9. Let i > /. Then there is a matrix comprising only zeroes and having 
n — ) columns in the first / rows of the minor M tl complementary to a./. Since 

■J4-(»—/)-«>* -1. by 3.1.20, M u = 0. 

3.2.10. D' = D n -K 

3.2.11. (a) The i-th row of D' is unaltered and all the others are multiplied 
by a. The whole determinant D' is multiplied by a 71-1 ; (b) the t-th and j-th rows 
are interchanged, and then all the rows are multiplied by (—1). The overall 
change of the determinant, thereby, has been that it was multiplied by (—l) n+1 ; 
(c) all the rows of D' , except the <-th, are unaltered; the corresponding elements 
of the ;-th, premultiplied by a, have been subtracted from the elements of the 
Mh row. The determinant D' is unaltered; (d) D' is transposed. 

3.2.16. 216. 3.2.17. -106. 3.2.18. 1. 3.2.19. 120. 3.2.20. —11. 3.2.21. -2. 
3.2.22. -13. 3.2.23. 1. 3.2.24. 15. 3.2.25. 3. 3.2.26. 7. 

3.2.28. -12. 3.2.29. 16. 3.2.30. 1. 3.2.31. -400. 3.2.32. -36. 3.2.33. 0. 
3.2.34. 8. 3.2.35. —1. 

3.2.37. | (4»« — 1). 3.2.38. 4 n « - 3"* 1 . 3.2.39. 2"« - 1. 3.2.40. 5 n . 
3.2.41. y ( 1 + (—1)”)- 3.2.42.1(1 4- (-1)»). 3.2.43. 1 4- 3.2.44. 6"(1 4-In). 

3-(t+1 M ~ 0- ~ a i+i)ft (^)— b t +i c i+ifi-i (^)- 

•''.3.2. The property indicated is possessed by an orientation volume of a 
parallelepiped in any Euclidean or unitary space. 

3.3.5. (a) It follows from Hadamard's inequality; fb) let e be the nth'root 
of unity, i.e. e = cos 2 nln 4- l sin 2 n/n. Then the estimate indicated in (a) is 
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reached by the determinant 


11 1 ... 1 



<c) for n = 2 the estimate occurs for the determinant 


If the estimate is reached by the determinant of the matrix A n for n = 2*. then 
for m = 2* +1 , the determinant of the following matrix of order 2 n must be 
considered 



3.3.6. If the modulus of the element a,j is less than 1 for a certain pair of 
indices i, j in the given determinant d n , then d n is increased on replacing at) 
by 1 if A t f > 0, and by replacing ay by —1 if An < 0. Finally, it A,] = 6, 
then the determinant is unaltered when a t i is replaced by either of these numbers- 
Similar reasoning, with respect to the minimum of the determinant, shows that 
the determinants of a given order .with the maximum modulus is a determinant 
made up of l’s and — l’s. 

3.3.7. To prove the inequality h n _ l < h n , it suffices to enclose the determi¬ 
nant dn.j of order n — 1 made up of 0 and 1 and whose modulus equals 



so that a determinant of order n, also made up of 0 and 1 and whose modulus 
equals /i n _„ is obtained. 

To prove the inequality h n < g n . l , consider the extremal determinant made 
up of 0’s and l's; interchange its rows so that the (1, 1) position contains a 1 and 
make all the other elements of the first column equal to zero by subtracting 
from the subsequent rows. Then a determinant of order n — 1, whose elements 
are 0, 1, —1 and modulus equals to h n , will be obtained in the bottom right- 
hand corner. By 3.3.6, the modulus of such a determinant does not exceed g n . t . 

To prove the inequality g„_, < g n , it suffices to enclose the extremal deter¬ 
minant d n .i, made up of l’s and —l’s, in the way indicated in the proof of the 
first inequality, and then to use 3.3.6. 

For the proof of the last inequality, consider the extremal determinant 7 n 
with the elements 1 and —1. Multiplying, if necessary, the rows and columns 
of this determinant by —1, make all the elements of the first row equal to 1, 
and all the elements of the first column, beginning with the second element, equal 
to —1. Now, adding’the first row to all the others, we shall obtain, in the bottom 
right-hand corner, a determinant of order n — 1 made up of 0’s and 2’s and 
equal in modulus to g n . Factoring out the 2’s we shall see that this determinant 
is the product of 2 n ~ x and some determinant of order n — 1 made up of 0’s and 
l’s. Hence, the required inequality. 
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3.3.8. According to 3.3.7, h s < g a = 2. That h s = 2 is shown, for example, 
by the determinant 

I 1 ° l \ 

1 1 ° * 

10 1 1 | 

Since obviously h, = 1, by 3.3.7, g a < 4. Since g s > g 2 = 2 and g s is a mul¬ 
tiple of 4, g s = 4. 

3.3.9. Let d n -i be the extremal determinant of order n — 1 made up of 
1's and — l’s. Denote the columns of this determinant by a lt a t , . . ., a n _! and 
construct the determinant of order n, which also contains only l's and —l’s: 



Only two of the minors of order n — 1 in the first n — 1 rows of the determinant 
are nonzero. Hence, expanding by the last row, we find that d = 2d n _,. 

3.3.10. According to 3.3.5, 3.3.7 and 3.3.9, g B is a multiple of 16 and g B > 
> 2 g t = 32. On the other hand, by Hadamard’s inequality 

ff6<(l/5) 5 =25l/5<64. 

Therefore, g B is either equal to 32 or 48. The method of enclosing the extremal 
determinant of order 4, indicated in the solution to Problem 3.3.9, makes it 
possible to obtain, for a determinant of order 5, an estimate of 32. Hence, en¬ 
close the determinant in a different way: 

1 —1 — 1 1 1 

1 1 — 4 —1 —1 

1_1 1 —1 1 

1111 1 

—1 1 — 1—1 1 

.This determinant equals 48. Thus, g s = 48. 

3.3.11. Assume that M = 1 and enclose a determinant d of order n in the 
following way: 



The new' determinant d of order n + 1 equals dll. Now subtract the first row 
of d from all the others. Then the modulus of all elements of the determinant 
does not exceed 1/2 and, according to 3.3.5, (a), 

d/2 < (l/2) n#I (n + 1)<" +1 >/*. Q.E.D. 

3.3.13. (a) The determinant G (i lt . . x h ) has a diagonal form and equals 
1 ari | a -1 jt_| * ... | x h I s ; (b) the determinant G (x lt . . ., x h ) has a “quasi-diagonal 
form” and equals G (x lf . . ., x t ) G (ij+i, . . ., x fc ). 

3.3.14. (a) The determinant is unaltered; (b) the determinant is multiplied 
by | a | ! ; (c) the determinant is unaltered. 

3.3.20. According to 3.3.18, G 1 /* (a lt . . ., a n ) is the volume of the paralle¬ 
lepiped drawn on the vectors a lt . . ., o n ; det A has the same meaning. 


18-0619 
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3.3.25. The Gram determinant does not exceed the product of two of its 
minors, complementary to one another, and is equal to this product if and only 
if at least one of the minors is zero or all the elements of the determinant, out¬ 
side these minors, are equal to zero. 

3.3.27. When k = 3, the inequality assumes the following form 
V (*1, *„ * 3 ) < S (* lt Xj) S (x lt x 3 ) S (x 2 , x s ). 

Thus, the square of the volume of the parallelepiped drawn on the vectors 
*it x t , x, does not exceed the product of the areas of its faces. 

3.3.29. If all the elements of some row of an orthogonal determinant are 

n 

replaced by ej, j = 1, . . n so that e ! = 2 I «; I* < 1. then the new deter* 
1-1 

minant d' satisfies the inequalities 

1 - I e | < | d' | < 1 + | e |. 


3.3.20. The modulus of the minor at the intersection of the rows numbered 
ti,. . i A and the columns;!,. . ., ;' A is the volume of the parallelepiped obtained 
by projecting the indicated rows on the coordinate subspace of the vectors 
ej l , . . ., e ]h where e lt . . ., e n is the natural basis for the arithmetic space. 

3.3.32. If the base of the corresponding n-dimcnsional parallelepiped P n 
is reckoned to be the (n — l)-dirocnsional parallelepiped P n _, drawn on the 
first n — 1 rows, then P n has a very small height and a very large volume of the 




• ,P) 

P — 1) * 


3.4.6. a<, p ; _,) = 


P-1 P\ 
P-1 j) 
•.P-1) 


P</<«. 


3.4.10. 4. 3.4.11. —16f. 3.4.12. -12. 3.4.13. 5. 3.4.14. 0. 3.4.15. 80. 3.4.16. 3. 
3.4.17. 2-9.3- s -5-«.7-«. 3.4.18. 240. 3.4.19. -1/2. 3.4.20. -18 016. 3.4.21. 2. 
3.4.22. -1. 3.4.23. 5. 3.4.24. 16. 3.4.25. 63. 3.4.26. 32. 3.4.27. 1. 3.4.28. 13. 

3.4.29. This number is a polynomial in n with the higher-order term equal 
to n 3 /3. 

3.4.30. (a) The higher-order term of the number of operations equals n ! /2; 
(b) the higher-order term equals 3 n. 

3.4.31. Evaluate the determinant d n +! so that d n remains the leading prin¬ 
cipal minor of d„+ I . If the matrix of the determinant is triangular, start the 
operations at the upper corner. 

3.4.32. It follows from the condition of nondcgoncracy that all the leading 
principal minors may be made nonzero by interchanging the rows only; inter¬ 
changing the first n — 1 columns is also possible. Then the Gauss method is 
performed for the last columns of all the k determinants. 

3.4.33. For example, place the first row last and carry out the same operation 
over the first column. 

3.4.36. For example, the determinant 

1 0 0...1 

—1 1 0...1 

- 1-1 1 ... 1 . 

—1 -1 -1 ... 1 
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3.4.38. The statement does not hold for the Gauss method with partial pivoting; 
an example is 

11 10001 
|l 2000|* 


3.4.39. Assume that max I I = 1. Let a = | <4|’ |, P = | |. Then 

P s£ 2a, aB < 4, whence p < 2J/2 < 3. 

3.4.42. The determinant equals 1 and the length of each of its row equals 1. 
According to 3.3.4, the rows of the determinant are orthogonal each to each. 

3.4.43. (a) 2" (del A) 1 ; (b) 0; (c) (del ,4)*; (d) (-1)" (deti4)». 

4.1.4. All the matrix elements not in the basis minor are zeroes. 

4.1.5. See the answer to Problem 4.1.4. 

4.1.14. If 6 lt . . ., b m , c,, .... c n is a convenient set of numbers, then for 
any number a, a # 0, the set ab ,, . . ., ab m )-<\> ■ • c n is also convenient. 

CL Or 

4.1.17. No. A counter example is 


4.1.18. The rank is either unaltered or changed by unity. 

4.1.19. The rank is changed by not more than unity; not more than *. 

4.1.21. 0, 1, 2. 

4.1.28. 1. 4.1.29. 4. 4.1.30. 3. 4.1.31. 3. 4.1.32. 4. 4.1.33. 4. 

4.1.34. The dimension equals three. 

4.1.35. (a) Yes; (b) yes; (c) no. 

4.2.7. Such a plane consists of only one vector. 

4.2.8. Such a plane coincides with the whole space. 

4.2.9. n. 

4.2.12. If zp, x y , . . ., x h is the given set of vectors, then x 0 may be chosen 
as the translation vector of the required plane and the span of the vectors x, — 
■—x 0 , .... xi,—x 0 as the direction subspace. 

4.2.15. Ly + L t . 

4.2.16. LifX^O, Oii\=0. 

4.2.17. Yes, if L = O; in this case M coincides with V. No, if L =?& O, since 
multiplication by a number, as it is defined in 4.2.16, may yield a result which 
lies outside M. 

4.2.18. Retain the definition of multiplication by a number for nonzero 
numbers Put 0 -P = L for any plane P = x 0 + L. Then L is the null element 
of the space M. 

4.2.19. dim M = n — k. 

4.2.20. The indicated plane contains the vector t, but does not contain the 
vector v. 

4.2.22. (a) The straight line does not intersect the plane; (b) the straight line 
has only the vector z« = (2, 1, —2, 2) in common with the plane; (c) the 
straight line lies in the plane. 

4.2.23. The straight lines have one common vector i 0 = (—5, 11, —16, 
—11, 7). The plane passing through this vector and having the span of the vectors 
ft and g, as its directional subspace, contains both the given straight lines. 

4.2.24. Draw a plane through x t parallel to the span of the vectors z a — x 1( 

4.2.25. The planes have only the vector z« = (1, 2, 1, 0, 1) in common. 

4.2.26. The planes do not meet, whereas their directional subspaces intersect 
only in a null vector. 

18* 
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4.2.27. The planes do not meet, whereas their directional subspaces intersect 
in a one-dimensional subspace drawn on the vector 2pj + p* = g* — g1 = 
= (5, 1, 0, 0, 5). 

4.2.28. The planes intersect in the straight line x = z 0 + q % t, where z 0 = 
= (-2,-1, 6, 6, 7). 

4.2.29. The planes do not meet. Meanwhile, their directional subspaces coin¬ 
cide. 


4.2.30. The planes coincide. 

4.2.34. Let P = x« + L h and e lt . . ., e h be the basis for L h . Extend it to 
form a basis for the whole space: e lt . . ., e h , e h + lt . . ., e n . Then the following 
can be taken as the required hyperplanes 


n i = x 0 +He l , ... e k , efc+ 2 , . . .. 

n t = x t + L(e lt .... e h , e h + lt e h+3 . e„) 


*n-h=*o + £(«P •••.eh. .«n-i). 

4.3.1. If x 0 is an arbitrary vector fulfilling the condition (n, x 0 ) = 6 (the 
vector a 0 n, a 0 = b/(n, n ), for example, can be chosen as x 0 ), then the given set 
is a hyperplane of vectors of the form x 0 + y where y is any vector orthogonal 
to n. This hyperplane is a subspace if and only if b = 0. 

4.3.5. n (/) = 1 + cl + e*t* + • • . + b = d. 

4.3.8. Let x 0 be an arbitrary vector of the intersection. Rewrite the equations 
of the hyperplanes in the form 


(«i. * - x 0 ) = 0, 

(n,, x — x«) = 0, 


(« h , x — x t ) = 0. 

Hence, the intersection of the given hvperplanes is the plane P = x 0 + L, where 
L is the orthogonal complement of the span of the vectors n lt . . ., n h . 

4.3.10. The orthogonal complement of L is drawn on the vectors z, = (—3, 
1, —2, 0), z, = (1, —1, —2, 1) (see 2.3.6). Therefore, P can be described, for 
example, by the system of equations: 


(Zj, *) = (z„ *») 

(z„ *) = (z„ x»), 

—3c4 + — 2a» = —4, 

<*! — a, — 2a, + o 4 = —1. 


4.3.14. z 0 = a 0 n, where a„ = b/(n, n ). 

4.3.16. /(<)«*!• 

4.3.19. 5. 4.3.22. 2. 4.3.23. 2. 4.3.24. 150. 4.3.25. 5. 4.3.26. 5. 4.4.4. 0, 7. 


4.4.5. When X # 1, 2 the system has a unique solution; when X = 1 it has 
a one-dimensional, and when X = 2, a two-dimensional solution subspace. 

4.4.6. When X — 1, —2 the system has a unique solution; when X = — 1 
it has a one-dimensional, and when X = —2, a three-dimensional solution sub¬ 
space. 

4.4.8. The pivots are equal to the ratios of the corner minors. 

4.4.10. The linear dependence of the vectors z,, . . ., z h is obviously due to 
the linear dependence ot the vectors y u . . ., y h . Conversely, let now at least 
one of the coefficients in the equality a t z x -}-... + o h Zk = 0 be different from 
zero. Then two solutions of system (4.4.1), the zero solution and Oj u, + . . . 
. . . + a h y h , have the same values for the last n — r components. Therefore, 









Answers and Solutions 


277 


Ojy, + • • • + o h yh = 0, i.e. the vectors y,, . . ., y k are linearly dependent. 

4.4.14. When tne Gauss method is used and the subsequent formulae are 
derived for the general solution, only elementary transformations over the rows 
of the indicated submatrix are performed. The final result is the matrix C (the 
zero rows from the (r + 11th to the m-th are omitted). 

4.4.16. Any vector of the 4-dimensional arithmetic space is a solution of the 
system. 

4.4.17. For example, a general solution is: x x = — jx s + ~x a , x 4 = 0. The 


fundamental system of solutions is: y 4 = (—7, 3, 0, 0), y t = (5, 0, 3, 0). 

4.4.18. The general solution is: x 3 = 2x t + 5x t — 9x 4 . The fundamental 
system of solutions is: y t = (1, 0, 2, 0), y t = (0, 1, 5, 0), y 3 = (0, 0, —9, 

4.4.19. The system has only a zero solution. 

4.4.20. The general solution is: x 4 = x 4 , x 2 = x 4 , x 8 = —x 4 . The funda¬ 
mental system of solutions has only one vector, e.g. y = (1, 1, —1, 1). 

4.4.21. The general solution is: x 4 = 2x 8 + 8x 4 , x 2 = —x 8 — 2x 4 , x 6 = 0. 
The fundamental system of solutions is: y t = (2, —1, 1, 0, 0), y 2 = (8, —2, 
0, 1, 0). 

1 41 

4.4.22. The general solution is: x 4 = — jj-x 8 — 12x 4 -^-i 5 , x s = x 8 — 

— 9x 4 — 18x 5 . The fundamental system of solutions is: y . = (—1, 2, 2, 0, 0), 
y t = (12, 9, 0, -1, 0), y 3 = (41, 36, 0, 0, -2). 

4.4.23. The general solution is: xi = x 2 =jx 6 , x 8 = x 4 = — jx 6 . The fun¬ 
damental system of solutions consists of a unique vector, e.g. y = (1, 1, —3, 
—3, 7). 


4.4.24. Thegeneral solution is: x, = — ^x 9 — g-x # ,x, = — |x 8 + 4^5. = 0. 
The fundamental system of solutions is: y 2 = (2, 9, —6, 0, 0), y 2 = (—2, 3, 
0, 0, 6). 

4.4.25. The general solution is: Xi = —x 8 = x 8 = —x 4 + 3x # . The fun¬ 
damental system of solutions is: y 4 = (—1, 1, —1, 1, 0), y % = (3, —3, 3, 

4.4.26. The first three columns of the matrix are linearly dependent; the 
fourth column is not linearly dependent on the rest, therefore x 4 = 0; the same 
is valid for the fifth column, thus x b = 0. 


1 


4.4.27. x 4 , x ( ; x t , x 4 ; x 8 , x 4 ; x 8 , x ( ; x lt x s \ x t , x 8 . 

4.4.28. re + 1 — k. 

4.4.29. The basis for the subspace is formed, for example, by the polynomials 
ft (0 = t* - 6 1 3 + lit' - 6 1 and f t (!) = t» - 25*» + 60t» - 36t. 

4.4.30. (a) For example, 


70x,— 16 x 8 +4x 8 + x 4 =0, 
— 5x, +x 2 — x 8 + x 8 =0. 


In order to answer (b), (c), any linear combination (two linear combinations) 
of the equations of (a) can be added to (a). 

4.4.31. No. The given systems are not equivalent. 

4.4.33. (44, -11, -31, -6). 

4.5.6. When \ # 0.6 the system is defined; when X = 0 it is inconsistent; 
when X = 6 the system has a two-dimensional solution plane. 

4.5.7. When X # —1, 2 the system is defined; when X = 2 it is inconsistent; 
when X = — 1 the system has a two-dimensional solution plane. 

4.5.12. For example, the general solution could be: 


_ 45 ,37 

x *~ 


42 

19 * 4 ' 
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4.5.13. The system is inconsistent. 

4.5.14. For example, the general solution could be: xj = — 1 + x s + 2x 4 , 
x a = —3 -f- Xj -f- 2z 4 . 

4.5.15. The system has the unique solution: x t = 1, x t = —1, z* = —1, 
z 4 = 1. 

4.5.16. The general solution is: x 4 = 6 — z 5 , x, = —5 + x 6 , x s = 3, x 4 = 
= -1 - x 6 . 

3 3 39 1 

4.5.17. The general solution is: x, = — -g -1 *’ x3 = -jj-+ 


4.5.18. The general solution is: x, =-g -—-r 


x » = °- 


4.5.19. The system is inconsistent. 

4.5.20. The system has the unique solution: x t = x t = x s = x 4 = 1, x 6 = 2. 

4.5.21. The general solution is: x i = ^ — y* lt x 3 = z 4 = 0, z 6 = ^ — -g-z ( . 

4.5.22. The system is inconsistent. 

4.5.23. When X 5 the system is inconsistent. When X = 5 the system is 
consistent and its general solution could be, for example, x t = —4 + x», x, = 



4.5.24. When X —3 the system has a unique solution 

_ _L_ _ 4X+11 x +11 

*1- X + 3 ’ x *~ 3(X+3) ’ Xa_ 3(X + 3) • 


When X = —3 the system is inconsistent. 

4.5.25. The system is consistent for any value of X. When X # —95 the gen¬ 
eral solution is of the form x, = 0, x, = x 3 . When X = —95 the general 

... 13 . 19 23 

solution is: *i = jjj *» - T2 X *‘ 

4.5.26. When X^= 1, —2 the system has the unique solution 


When X = 1 the general solution is: x 4 = 1 — x, — x 3 . When X = —2 the 
system is inconsistent. 

4.5.27. When X# 1, —2 the system has the unique solution 

1 _ 

*i- x i--T=r» x »-i—r- 

When X = 1 the system is inconsistent. When X = —2 the system is consistent 
and its general solution is: z, = x 3 = — 1 + x s . 

4.5.28. When X 1, —2 the system has the unique solution 

3 3(X+1) 

Xl X * tX-l)(X+2) ’ x » (X—l)(X + 2) * 

When X = 1 and X = —2 the system is inconsistent. 

4.5.29. When X 1, 3 the system has the unique solution 


X—4 
= ~X—"3 ’ 
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When X = 1 the general solution is: x x = 1 — x, — x s . When X = 3 the system 
is inconsistent. 

4.3.30. When X ^ 1, 3 the system has the unique solution 
2 _ n 3-7X 

** — 3— X ’ i 2- 3 's- 0 ’ (X —1) (3— X) * 

When X = 1 the system is inconsistent. When X = 3 the general solution is: 



4.3.31. The third column of the matrix of the system is linearly indepen¬ 
dent of the remaining columns; the fifth column is linearly independent of 
the remaining columns of the augmented matrix of the system. 

4.3.32. No. The formulae are not equivalent. 

4.5.33. Yes. 4.5.34. n + 1 - k. 

4.5.35. The indicated conditions determine a two-dimensional plane. If 
/„ (i) is a polynomial in this plane, then the polynomials /„ (t), / 0 (0 + /i(0i 
ft (0 + ft (0. where f x (<) and / 4 (<) form a basis for the directional subspace, 
are linearly independent. For /, (<) and / 2 (t). the polynomials of Problem4.4.29 
can be taken. 

x x = 2, x, = 1, x* =1, x 4 = 3. 

ap—bq—cr — ds bp \-aq — dr- cs 

**- J -* **- a -’ 


4.5.36. 

4.5.40. 


■hs 


cp+dq+ar- 

- — , 

4.5.42. / (<) = I s - 4<* + 3t - 2. 

4.5.43. / ( t) = -3t» + It. 

4.5.47. / (0 = O - 4<* + 3< - 1. 
4.5.49. / (t) = 2t* — <» — 3<* — 2< + 1 
4.5.51. /(/) = 2<‘ -4t' -3<*+ 5< 


4.5.51. / (0 = 2<‘ - 4t‘ - 3+ 5* - 2. 

4.5.53. For the function / and its derivatives, write the system of equations: 


hi =s 

h'f+hf' =«' 

hmi + 2h'l'+him =gW 


hWf + n/,(n-i)/' + C*fc< n -i>/<®) -i- ... + him = g m. 

Using Cramer’s formula for /("), we obtain the required relation. 

4.5.54. /<») (1) = -2. 

5.1.1. Yes, if a = 0. No, if a # 0. 5.1.2. See the answer to 5.1.1. 5.1.3. 
Yes. 5.1.4. Yes. 5.1.5. Yes. 5.1.6. No. 5.1.7. Yes. 5.1.8. Yes. 

5.1.9. Yes, if a = 0. No, if a # 0. 5.1.10. Yes. 5.1.11. No. 5.1.12. No. 5.1.13. 
Yes. 5.1.14. No. 

5.1.15. No. 5.1.16. Yes. 5.1.17. No. 5.1.18. Yes. 

5.1.19. Yes. 5.1.20. Yes. 5.1.21. Yes. 5.1.22. Yes. 5.1.23. Yes. 5.1.24. Yes. 
5.1.25. No. 5.1.26. No. 5.1.27. No. 

5.1.34. Any operator on the space B* raises all the numbers of this space lo 
a power with a fixed'(for a given operator) real exponent. 

5.1.36. No. 5.1.37. Yes. 

5.1.40. (a) Yes; (b) no. 

5.1.44. No, if the set x,, . . ., x fc is linearly dependent. 

5.1.45. Yes. 
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5.1.47. For linear functional <p on the space M n to be given by the formula 
<p/(() = / (a 0 ), it is necessary and sufficient that the numbers 

. , L . e,= 1=0. 1.n, 

satisfy the relations 

r 0 =l, Ci+l =const, t = 0, 1, .... n— 1. 

c i 

5.1.52. No. Any operator on the space C, obtained in the indicated way, 
converts “real” vectors (i.e. vectors of tne form x + iO) back into real vectors. 

5.1.53. No, if this functional is not zero. 

5.1.55. Yes, if dim Y > dim X\ no, if dim Y < dim X. 

5.1.56. No, if dim Y > dim X\ yes, if dim Y < dim X. 

5.1.59. N a ; 0. 

5.1.66 n, if/= 0; n — 1, if/# 0. 

5.1.67. A two-dimensional space of vectors orthogonal to a; a two-dimen¬ 
sional vector subspace coplanar with a and b. 

5.1.68. N a is a straight line drawn on the vector a; T A is a plane perpendicular 
to the vector a. 

5.1.69. If (a, 6) = 0, then N A is a plane perpendicular to the vector a and 
T a is a straight line drawn on tne vector 6. If, however, (a, 6) =£ 0, then N A 
is a straight line drawn on the vector 6 and T A is a plane perpendicular to the 
vector a. 

5.1.70. r A = 1, the basis for the image is y = (1, 1, 1); n A = 2, the basis 
for the kernel is: Z 1 = (1, —1, 0), Z 2 r = (1, 0, —1). 

5.1.71. r A = 2, the basis for the image is: y 1 = (2, 1, 1 ),y t = (—1, —2, 1); 
n A = 1, the basis for the kernel is \ Z — (1, 1, 1). 

5.1.72. r A = 3; n A = 0. 

5.1.73. The image is: the kernel: Af 0 . 

5.1.74. See the answer to 5.1.73. 

5.1.75. n + 1 — k, if k < n + 1; 0, if k > n + 1. 

5.1.76. N p = L 2 ; T p = L,. 

5.2.7. Let e,, be a basis for the space X, and let for the given op¬ 

erator A from w.vv 

Ae 1 = a, if! + «2i</s + • • ■ + <* m i7m* 

Ae t = a 12 9, + a,,17, + . . . + Oms7 m , 


Ae n = “ln</l + a *n?* + • • • + 

Put 

B 2 e x = n n <7i, B t e x = a tl q t , . . ., B m e 1 = Omi<7 m > 
B x e 2 = «i2<7ii B 2*2 = a zz9s> ■ • &m e 2 = a m2 < lm> 


Bie n = a ln9l , B t e n = a tn q 2 . 


B m e n — a mn < hn- 

n satisfy the conditions of the 


It is obvious that the operators B f , i — 1, . . ., m satisfy the conditions of the 
problem. 

5.2.11. dim = mn. 

5.2.12 (a) No, if T =* 0\ (b) no, if N =£ X. 

5.2.13. dim co XT = kn. 

5.2.14. dim K w = m (n - /). 

5.2.20. Let e,,'. ej (d = n — r) be a basis for N A ; e lt . . ., e d , e d+1 , . . . 
. . ., e n a basis for X. Then the vectors y x = Ae d+l , . . ., y T = Ae n make up 
a basis for T A . The required representation of the operator A is given by the 
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operators B lt . . ., B r determined by 


B,eh — | 


0 , 

Vi. 


k # d ; i 
k = d+i. 


5.2.21. Either N A = N B or T A = T B . 

5.2.22. Let all operators of L be of rank <1, and let A be an arbitrary op¬ 
erator of rank 1 from L. Consider a subset Zq, in L, of all operators B for 
which NgZ)N A , and a subset L t of all operators C for which c T A . 
According to 5.2.13, 5.2.14, these subsets are the subspaces of L of dimension 
^n. Therefore Zq =/= L, L t # L, and there exists an operator D from L such 
that D $ Lj, D&L t , i.e. T D # T A , N D J= N A . But then (see 5.2.21) A + D 
is of rank 2. 

5.2.23. No (sec 5.2.8). 

5.2.24. Yes. 

5.2.26. N e . p = T P , T e - p = N P . 

5.3.4. No. 

5.3.6. n (n — r). 5.3.7. n (n — r). 5.3.8. The rank equals nr, the defect 
n (n — r). 

5.3.10. Let * 6 N q + h . Then 

A‘i*h x = Q=A<i*i (Ah~*T). 

Since N q = N. +l , 

An (Ak-i x ) = 0=A<i+k-'x, 


i.e. x £ N q *k- 1- Therefore, A r fl+fc = N q+h . v Continuing to reason in the same 
way, we obtain 

Nqi-h = Mq+h-1 = ^q+h-l = • . . — IVg+l = N q . 


5.3.12 n+ 1. 

5.3.19. If D is a differential operator, then 


5.3.21. Let <p (A) = 0 and q> (<) = q ( t) m (f) + r (<), where the degree of 
r ( l ) is less than that of m (1), or r (<) « 0. If r (<) is a nonzero polynomial, then 
r (A) = <p (A ) — q (A ) m (A) = 0, which is contrary to the definition of the 
polynomial m ( t ). 

5.3.22 Let mi (t) and m t (l) be two annihilating polynomials of the least de¬ 
gree. Moreover, we may assume that the higher-order coefficients of both the 
polynomials equal 1. If p (t) = mi (/) — m 2 (<) is a nonzero polynomial, then 
it is also an A-annihilator. 

5.3.23. (a) m (l) = t l — t if P =/= 0, E\ m (t) = / if P = 0; m (t) = t — 1, 
when P = E; (b) m ( t ) = /* — 1; (c) m (/) = 19. 

5.3.25. No. 

5.3.31. That P\P t ' s a projection operator follows (see 5.3.17) from the equal¬ 
ity 

( PiP t y = PiP t PiP t = P\P\ = PiPf 

It also follows from the commutativity of Pi and P t that T PlP2 <=. T Pi fl T Pr 
If, conversely, x £ T Pl D T Pv then Pjz = P t x = x __ and PiPfX = x, i.e- 
* £ t Pip 2 - 

Using the commutativity of Pi and P t again, we^obtain that N Pl <=: N PlP2 
and Np 2 czN Pl p 2 , i.e. N Pi -(- N Pz CZ Np lP2 - Now, if x(.Np lPi , then 
P t x 6 N Pi , and ( E — P t ) x £ Np 2 . The identity x = P t x + (E — P t ) x proves 
the reverse inclusion relation: N Pl p 2 <=. N Pl + Np 2 
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and hence 
Therefore, 


5.3.32. It is easy to verify that it follows from P x P t = P t P t = 0 that (Pi + 
+ P,)* = Pj + P % , i.e. Pi + P, is a projection operator. Conversely, let 
(P, + P«y = Pi + Pt . Whence 

P t P, + P,P 2 = 0. 

Premultiplying and postmultiplying this equality by P lt we obtain 
PiP t Pi + PiP t = 0, P t Pi + P,P 2 P, = 0, 

P S P, ~ PiPt = o. 

PiPt = P*Pi - o. 

The inclusion T Pi+P2 cz T Pi + T Pz is obvious. It follows from the equality 
P t P s = 0 that Tp 2 a N Py Since the sum T Pl + N Pi is direct, the same il 
true for the sum T Pi + T Pz . Now, if * 6 T Pl + T Pv i.e. x = + x t (where 

x i 6 Tp P x t 6 fpj), then 
(Pi + P i )x= (Pi + P ,) z, + (Pi + P t ) z t 

= (^1 + P *) + (Pi + P * ) P*t = P \*1 + P\*t = *l + x a = x, 

s.e. T Pl + T Pz <=. T Pt+P2 . 

Since T Pl (1 T P% = 0, it follows from * £ N P{ + p 2 (i.e. from P t z = 
= -Ptx), that * 6 ^p, H N Py 

5.3.38. The operator that matches each function with its (unique) antide¬ 
rivative belonging to the given space. 

5.3.41. The kernel of each of the operators B + A and E — A, in case they 
are degenerate, should coincide with the image of the operator A. But for a 
nonzero vector z, the equalities — Ax = x and Ax = x cannot be both true. 

5.3.51. Yes, if dim Y = dim X; no, if dim Y > dim X. The case of dim Y < 
< dim X is impossible. 

18 —12 Oil 


5.4.1. AB= — 1. BA = 


-9 0 


5.4.4. AB = (—15 97 78 —112) 


5.4.5. AB - 
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5.4.6. AB = (- 1 0 -1 4). 


5.4.9. ABCD = 5 


-G 3 
-10 5 
-14 7 


II 0 1 


5.4.16. X = 


|1 1 


5.4.17. 


1 1 1 

||i i -i||* . 0 1 0 * 

I 0 1 1 || 

5.4.19. There are mpn multiplications and mp (n — 1) additions. 

5.4.20. mp(n + q) multiplications are required for the product (AB) C, 
and nq (m + p) multiplications for A (BO- 

5.4.25. (a) The i-th row is multiplied by ai+, and added to the (i + 11th 
row of A then, premultiplied by a 1+Jl , instead of a t+1 ,., the i-th row is added 
to the (i + 2)th row. This sequence is repeated until the i-th row, premulti¬ 
plied by is added to the n-th row; (b) as in (a) the i-th row is premultiplied 
this time by a,,, . . ctj t i, i, - . a ni and added to the i-th, 

(i + l)th, . . ., n-th rows, respectively. 

In the postmultiplication case: (a) each of the subsequent rows premulti¬ 
plied by a hl , k = i + 1, . . ., n, respectively, and in turn is added to the i-th 
column of A; (b) each of the subsequent columns premultiplied by a hl , k ^ i. 
respectively, and in turn is added to the i-th column of A. 

5.4.29. I 


5.4.30 


■ i: :i- 


where c t are the Fibonacci numbers, i 


0 


-- 1, e h = c h-i + c k-i- 


0 
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when k = 2m and 

o | 

K+W 

x“ +, xr> o 

when k = 2m + 1. 

5.4.33. If the given matrix is denoted by A, then for B = A h and k < n, 
we obtain bi, i th = 1, l = f, . . n — k, the other elements b tJ being equal 
to zero. When X > n, f> = 0. 

5.4.34. Let the given matrix be A. Then for B = A h and k < n, we obtain 
6 t . Uh = l, , = 1, . . ., n — X; b t . uh . n =1, i = n - k + 1, . . ., /»; the 
other elements b t j equal zero. For k = n, we obtain A" = E. If, however, k > n, 
then representing X as X = np + m, we obtain A h = i4 m . 

5.4.42. II a b c || 5.4.43. a b c ... h 

0 a 6 I a b . . 


5.4.44. n, the order of the Jordan block. 
5.4.46. »("+P>+ 2). 


5.4.55. 2 (m, + m.) + 1. 

5.4.60. a = Xjy, x t y t + . . . + x n y n . 

5.4.61. n (n+ 2). Represent the matrix AB as AB = (pr) v where P = 
= yi<\ + • • • + y„u n . To evaluate P, n multiplications are required; to eva¬ 
luate the column vector Pi, again n multiplications, but n* operations for (Bx) v . 

^ 5.4.62._ Construct the matrix B from a set of the basis columns of .A, the 


5.4.63. For example, 2 0 


5.4.64. For example, 


5.4.67. An arbitrary quasi-diagonal matrix whose diagonal blocks are of 
orders Xj, . . ., X r , respectively. 


2 Z*ijfj X e t = 0. Then 

2 (2 a fj/0 Xe < =o - 
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Due to the linear independence of the set e m , we obtain 

^ja„/, = 0, r = 1,..., m, 
whence for all i, j, a tJ = 0. 


5.5.3. 1 || a b II 5.5.4. 1 |] d -6 

+ ||-6 .||* ad 6c || — c a \ 



5.5.12. I a —b 

■ 1 6 a 

a*-i-b* + c* + dt c _ d 
I d c 



5.5.16. (a) Yes. E.g. the set of matrices of the form 


P- 

where a^O; (b) no; the equation Ax = B, where A is a degenerate matrix and 
B is a nondegenerate matrix, is inconsistent. 
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5.5.30. In the inverse matrix: (a) the i-th and ;-th columns are interchanged; 
(b) the i-th column is multiplied by the number 1/a; (c) the i-th columns multi- 










Answers and Solutioi 


plied by the number a is subtracted from the /-th. 



5.5.33. nl 

5.5.35. II 1 -2 1 Oil 5.5.36. II 15 10 -6 -4 

0 1—2 1 10 5 -4 -2 

1—1 1 —2 * II —9 —6 3 2 ' 

||-1 1 0 l|| || -6—3 2 1 

5.5.37. Reduction of the matrix A, to triangular form mentioned in the 
problem, only needs elementary transformations of type (c). Each stage of the 
Gauss elimination can then be interpreted as left multiplication of the current 
matrix by the sequence of matrices L hl or, equivalently, by the corresponding 
matrix N t . Finally, we obtain 

N n .i . . . N t . .. NiA = R, 

where R is an upper triangular matrix. Hence, 

A = (Np... A'r»... AT^_ t ) R. 

All the matrices Wi 1 are lower triangular with units on the principal di¬ 
agonal which is also true for their product. 

5.5.40. Reduce A by the Gauss elimination to an upper triangular matrix 
with units on the principal diagonal. Then, subtract appropriate multiples of 
the last row from the previous rows to make all the on-diagonal elements of 
the last column equal zero. The same is done for the next row and so on to the 
last row. 

5.5.43. Let be the matrices of elementary transformations involved in 
the reduction of A to the identity matrix, then 
M h ... MiA = E, 


A- 1 = M k ... M t . 



5.5.50. Perform the calculations in the following order: 1. A~ l x. 2. yA~ l . 
3. o = y (A- 1 *). 4. 8 = 5. P (A- 1 *)- 6. PA ~ X BA _1 = (pA->x) (j/A- 1 ). 

7. (A + B)' 1 . Then 3n 2 + 2n + 1 operations of multiplication and division are 
required. 


5.5.51. A -1 


r i*j. 


1 + Y cji 
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Here c*i is the (/, i) element of the matrix C = A- 1 , r, is the i-th column, and si 
is the /-th row of A- 1 . 

5.5.52. Let v = (y,, . . ., y n ), s = vA~', r„ the last column of A- 1 . Then 

irsr r -- 

5.5.53. Let e be a column vector (of the same order as A) all of whose ele¬ 
ments are equal to unity. Put t = A- 1 e, u = e r A~ 1 . Then 


where 5 is the sum of all elements of A ~ I . 


5.5.54. 


(a-6)(a + 6(n—1)) 


a = a + b(n — 2). 





5.5.57. 

«-«i‘ 1 1 1 III 


1 

a i a i 

1 -Ojt 

a t a 3 

f 

’ a,a„ | 

1 

1 

1 

a? 

1 

a 3 a 3 

1 — a 3 t 

' a 2 a„ i 

1 


«,as 

a z a 3 

“1 

a 3 a n 


_1_ 

i 

1_ 

1 -ant 


a,a„ 

a 2 a n 

a 3 a n 

aK 


where t = 1 + —+ — + . . . + —. 

«i <*s a n 

,,« r , -sj 
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5.5.62. Look for the partitioned matrix An 1 



where P n -i is a square matrix of order n — 1. From the condition A n A^ = E n 
we derive 


+ u n -i9n-i = ^n-i 

(a) 

An- if n-i +h«n-i = 0. 

(P) 

i»„_ 1 P„_ l +oq n _ 1 = 0, 

(Y) 

«'n-ir n -i + flb = i. 

(6) 

It follows from (P) that 


r n _i = —bAn 1 -! Wn-i- 

(•) 

Substituting in (6), we find b: 



o— ' 


Now, r n . t is determined from (e). 

Substitute the expression for P n -i, derived from (a), 


in (v): 
Hence 


Finally, find 


F n -i = ^Sii — ^iaUn-iJn-i 
— Vn-i^niiUn-iJn-i + a 9n-i =0. 





5.5.63. Evaluate in the following sequence: 

1. AjjLiUn-i- 2. Un-i^n-i- 3. ^a-i (^rii^n-i)* 

, 4. b. 5. r n - 1- 6. 9-ni* 7. r rt -j (^n-i^nij)* 8. Pn-i- 
Then 3n* — 3n + 1 operations of multiplication and division are required. 



A P B P = (E n ) p (a) 

as a system of equations in the elements of the matrix B p . This system is detei* 
minate. 


19-061 
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Apply the Laplace theorem to the determinant of the matrix A: 

P^ 

2 <i*+fei) 


2 -(i,t 


/KK...k' n . p \ 
\*M ...i'n-p i 


Ml. "hen 2 (/,— k,) 2 = 0, 

0, when 0,-ks)* --F 0. 

Obtaining the above decompositions for all the sets j p and fc lt k 2 , . . 

. . k p suchithat 1 < /i < /. < ... < ) p < n, 1 < A, < k t < . . . < k p ^ 
< n, we obtain that the numbers 


2 «*+**> /fclki ...k'n-p \ 
(- 1 ) / 


re the solutions of the system (a). 
5.6.1. II cos a -sin a || 5.6.2. 

|| sin a cos a ||‘ 


0 1 0 0 ... 0 

0>) 

0111... 1 

0 0 2 0 ... 0 


0023... n 

0 0 0 3 ... 0 


0 0 0 3 ... 

0 0 0 0 ... n 


0 0 0 0... n 

0 0 0 0 ... 0 


0 0 0 0 ... 0 


0 1 0 0...0 
0 0 2 0...0 
0 0 0 3...0 


0 0 0 0... n 
The matrix is of order n X (n + 1). 
" 0 0 0 ... 0 
1 0 0 ...0 
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The matrix ii 

s of order (n + 1) X «. 


5.6.5. (a) || 



5.6.6. (a) The first r elements of the principal diagonal are units; all the 
other elements are zeroes; (b) the last n — r elements of the principal diagonal 
are units; all the other elements are zeroes; (c) the matrix is diagonal, the first r 
elements of the principal diagonal being equal to unity, and the others to —1. 


1-5 -10 -7 II (b)| 

15 - 20 331| 

5.6.8. (a)| 

6 13 -10 ; 

7 - 24 38 • 


17 36 -271| | 

|o 0 01| 

5.6.9. (a) 1 

|| 1 0 0 0 || (b) A X B t ; 

(c) AxE + ExB t . 


0 0 10 . 
0 10 0 ’ 
0 0 0 1 


When the basis matrices are interchanged, the matrix (a) is unaltered, the 
matrix (b) is replaced by B T X A , the matrix (c) is replaced by E X A + 
+ B t X E. 

5.6.10. (a) B r X A; (b) E n X A + B r X E m . 5.6.12. 2. 5.6.13. 3. 

5.6.14. The last n — r columns of the operator matrix contain zeroes 
whereas the first r are linearly independent. 

5.6.18. (a) The i-lh and ;-th rows are interchanged; (b) the A-th and Z-th 
columnsJare interchanged. 



5.6.21. (a) P X Q r ; (b) P- 1 X «?“ X ) T - 

5.6.22. The operator G AD possesses the matrix 

(P-'AP) X (QBQ-')T 


with respect to the basis P n , . . ., F mn , and the operator Fab the matrix 
(P- 1 AP) X E n + E m X (QBQ-') T . 

5.6.31. No; when B = P~ x AP, B = (a P)- 1 A (aP) for any nonzero num¬ 
ber a. 

5.6.38. For example, for the matrices 



19* 
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we obtain 


llo oil 


IS 21 


5.6.40. No. For example, A 1 = 0, B* = B for the matrices A and B in the 
solution to Problem 5.6.38, even though A and B are equivalent. 


If X t , . . ., X„ are the eigenvalues of the operator A, then: 

6.1.3. The operator A' 1 has the eigenvalues 1/X,, . . ., 1/X n . 

6.1.5. The operator A — X 0 E has tne eigenvalues X t — X„, . . ., X n — X 0 . 

6.1.6. (c) The operator f (A) has the eigenvalues / (X,), . . ., / (X n ). 

6.1.7. No. 

6.1.10. The eigenvectors are those collinear' with a. The associated eigen¬ 
value is zero. 

6.1.11. The eigenvectors are polynomials of zero degree; the associated 
eigenvalue is zero. 

6.1.12. There are no eigenvectors. 

6.1.14. (11... l) r . 

6.1.15. The matrix A = xy always has the eigenvalue X - - x l y 1 + . . . 
. . . + x„i/ n . If the order of the matrix is greater than unity, then there is a 
zero eigenvalue. 

6.1.16. The nonzero eigenvalue is n, the associated eigenvector is (1 1 . . . 
. . . 1) T . The following equation for the components of the eigenvectors is asso¬ 
ciated with the zero eigenvalue: 


ctj + otj -f- . . . -j- a n = 0. 

6.1.17. The eigenvectors are the same as those of the matrix J n in Problem 
6.1.16. The eigenvalues are a + b (n — 1) and a — b. 

6.1.18. If B = T- 1 A T and * is an eigenvector of the matrix A associated 
with an eigenvalue X, then T~ l x is an eigenvector of the matrix B associated 
with the same eigenvalue. 

6.1.22. (a) The projection operator has eigenvalues 1 and 0, L t being the 
eigensubspace associated with X = 1, L 2 the eigensubspace associated with X = 0: 
(b) the reflection operator has eigenvalues 1 ana —1, where L l is the eigensubspace 
for X = 1, L 3 is the eigensubspace for X= —1. 

6.1.27. An operator of simple structure "stretches” the space in n linearly 
independent directions (n being the dimension of the space). The matrix of this 
operator with respect to the eigenvector basis is diagonal. 

6.2.1. (a) X — am (b) X* — (a u + o. 2 ) X + (a u a tt — ai2 a zi); (c) X 3 — 
— ( au ^~ a *‘ a * 3 ^ °u a 33 T 03*033 — a 1! a tl - a I3 a 3l — a t 3 a 3t ) 

6.2.3. X» - (*,*, + x t y t + . . . + x n y n ) X"- 1 . 

6.2.4. X n — aX n_1 — "t" 5*Cj 6 n _jC n _j) X n_ *. 

6.2.9. The sum of all principal minors of order k of the matrix A~ l equals 
the sum of all principal minors of order n — k of the matrix A divided by the 
determinant | A | (k = 1, . . n — 1). The determinant | A~ x \ is reciprocal 
of the determinant | A |. 

6.2.10. For example, the matrices 


are not similar. 


ni 


6.2.12. m (A) = y j^, X*. . . ., X n being the eigenvalues of the matrix A. 
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6.2.15. The eigenvalues are the diagonal elements a„, . . a„„. 

6.2.18. X 2 - (2 cos a) X + 1 =- 0. 

6.2.19. X 3 + | a | 2 X = 0. 

6.2.20. X n+1 . 

6.2.21. X". 

6.2.24. Xj = Xj = 2. The eigenvectors are all nonzero two-dimensional col¬ 
umn vectors. 

6.2.25. Xj = X s = 2. The eigenvectors are of the form a (1 1 + i) T . a ¥= 0. 

6.2.26. X, = 1, X 2 = 2, X s = 3. The eigenvectors for X = 1 are of the form 

a (1 1 1)7, for X = 2 of the form a (1 0 1)7, and for X = 3 of the form 
a (1 1 0)7-; « =/= 0. 

6.2.27. Xj = X, = 3; X s = 6. The eigenvectors for X = 3 are of the form 
a (0 1 -1 )T, for \ = 6 of the form a (3 4 — 2)7; o =/= 0. 

6.2.28. X,! — X 2 = 3; X, = 6. The eigenvectors for X = 3 are of the form 

a (—7 5 —6)7 + f) (6 —3 3)7 (a and 0 are not both zero), for X = 6 of the 

form a (1 1 —3)7 where a # 0. 

6.2.29. Xj = X, = X, = 0. The eigenvectors are of the form a (1 1 0)7 + 
+ P (0 1 2)7, where a and P are not both zero. 

6.2.30. Xj = —3, Xj = — 1, X s = 1, X 4 = 3. The eigenvectors for X = —3 

are of the form a (1 -3 3 —1)7; for X = —1 of the form a (1 —1 —1 1)7; 

for X = 1 of the form a (1 1 —1 —1)7; for X = 3 of the form a (1 —3 3 —1)7; 

a # 0. 

6.2.31. X t = X, = 0; X, = X 4 = 2. The eigenvectors for X = 0 are of the 
form a (0 1 0 —1)7, for X = 2 of the form a (0 1 0 1)7; a # 0. 

6.2.32. X, = X. = 0; X s = X 4 = 2. The eigenvectors for X = 0 are: 

o (2 -1 0 0)7 + p (3 0 0 -1)7, for X = 2: a (1 -1 0 1)7 + p (0 0 1 0)7; 

a and P are not both zero. 

6.2.33. Xj = X, = X a = X 4 = 3. The eigenvectors are of the following form: 
a (1 0 0 —1)7 + p (0 0 1 0)7; a and p are not both zero. 

6.2.35. (a) There are no eigenvalues; (b) Xj = 1 + 2i, X* = 1 — 2i. 

6.2.36. (a)X 1 =2;(b)X 1 = 2;Xj = l + l^, X,= 

6.2.37. (a) Xj = -1, X* = 5; (b) X, = -1, X. = 5, X, = 2 + i, X 4 = 2 - i. 

6.2.38. (a) There are no eigenvalues; (b) \j = t, X, = — i, X s = 1 + i, 

6.2.42. In the complex case the sum of the algebraic multiplicities of the 
operator eigenvalues equals the dimension of the space. In the real case this may 
not be true. 


110 0 2 

0 

0 

0 

0 0 1 1 0 

-2 

0 

0 

0 0 1 / 6 - 1 / 6 ’ 0 

0 

1/6 

0 

2 -2 0 0 0 

0 

0 ■ 

- 1/6 


6.2.44. The matrix is not of simple structure. 

I I 0 1 111 111 0 0 0 

0 2 1 0 0 1 0 0 

0 -1 0 2 * 0 0 2 0 

0 0 0 -l|| ||0 0 0 2 


6.2.45. 
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6.2.46. The matrix is not of simple structure. 


6.2.47. Ill 1 

1-12 -3 

114 9 

1 -1 8 -27 


1 0 0 0 

0—10 0 
0 0 2 O' 

0 0 0 -3 


6.2.48. The matrix is not of simple structure. 

6.2.52. X" - 1. 

6.2.53. Let e be an arbitrary eigenvalue of P, i.e. an arbitrary n-th root of 
unity. The eigenvector associated with e is, given collinearity, of the form 
(lee 2 ... e n_1 ) T . 

6.2.54. According to 5.4.52 any circulant is a polynomial in the matrix P 
(see Problem 6.2.52). A circulant of order n is determined by n numbers an, 
a,, • • •• “n-i- Given the polynomial / (t) = a 0 + a x t + a 2 i* + . . . + o nHl ( n -\ 
the eigenvalues of the circulant are the numbers/(e x ), . . ., / (e„) where ej, . . ., 
. . ., e n arc all the n-th roots of unity. 

6.2.55. The eigenvectors for Xj (i = 1, . . ., m) are 

a (X,"' 1 X?'* ... X*X| 1) T a =jfe 0. 

6.2.57. The only case that needs proving is when X„ is an eigenvalue of A. 
Let its multiplicity be k. Then the rank of A — X„£ is n — k (the matrix is of 
simple structure!). Since the characteristic polynomial of the matrix A — X 0 £ 
has a zero root of multiplicity k, the coefficient of X h of this polynomial is nonzero, 
and there is a nonzero minor among the principal minors of order n — k. 

6.2.59. (X - X,) ... (X - X m ). 

6.3.5. A is a scalar operator. 

6.3.11. The converse statement is not true. 

6.3.16. The nontrivial invariant subspaces are: the straight line w'hose direc¬ 
tion vector is a (the zero operator is induced on it), and the plane orthogonal to a. 
The operator induced on this plane is the operator of rotation through 90°. 

6.3.17. The spaces M h , 0 < k < n, and the zero subspace. 

6.3.19. Rewriting the condition B — P~ l AP in the form PB = AP and 
equalizing the first columns in the derived matrix relation, we see that b n is 
an eigenvalue of A , and the first column of P is its associated eigenvector. Hence 
to construct the transforming matrix P find an eigenvector of A and extend it 
arbitrarily to form a nondegenerate matrix. 

6.3.24. Select a basis e lt . . e n for the space so that the first vectors of 
this basis, <r,, . . ., e h , form a basis for L. Then the matrix of the operator A is 


An being the matrix of the induced operator AIL with respect to the basis e lt . . . 
. . ., e . Assume that A u is not of simple structure, and for a certain eigen¬ 
value X of this matrix of multiplicity p, r x = r Au _^ Eft > k — p. Let X be of alge¬ 
braic multiplicity q as of an eigenvalue of A 2! ; then r 2 = r A2z-\En-k^' ( n — *) — 
— q. Thus, X is an eigenvalue of A e of multiplicity p + q, but 

r A e -XE n > r i + r 2 > k — p + (n — k) - q = n - (p + q), 

which is contrary to the assumption that A e is of simple structure. 

6.3.33. The two-dimensional invariant subspace is drawn on the vectors 
x= (0 1 l) r and y = (2 1 0) r . 
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6.3.36. The eigenvalues of the operator are on the diagonal of the matrix 


6.3.41. II2 0 111 
0 1 0 


6.3.44. In accordance with Problems 6.3.19 and 6.3.38, construct a matrix P 
reducing A to triangular form in n — 1 stages. At the first stage, take the eigen¬ 
vector common to the matrices A and B to be the first column of the transforming 
matrix Pt 1 ). Then At 1 ) = (PWJ-MPC 1 ) and B(‘> = (PMy'BPV) are of the form 


A n _j and B n . 1 being square matrices of order n — 1. Construct the matrix P<*) 


so that the first column of P„. t is the eigenvector common to the (commuting) 
matrices A n . 1 and B„_j. Continuing in this manner, determine P as the product 
P<‘> P< 2 > . . . P( n_1 ), both matrices P'MP and P-'BP being upper triangular. 

6.3.45. For the commuting operators A and B, there is a basis for the space 
with respect to which the matrices of both the operators are triangular of similar 
form. 

6.3.48. Let a matrix A be similar to an upper triangular matrix R, and a 
matrix B to an upper triangular matrix T. Tnen A X B is similar to B X T, 
the latter also being upper triangular with all the possible products X,py placed 
on its principal diagonal. Similarly, the matrix A X E n + E m X B is similar to 
the upper triangular matrix/? X £ n + E m X T on whose principal diagonal all 
the possible sums X ( + \ij are placed. 

6.3.50. Select a basis .... <r n for the space so that e 1( . . e h form a 
basis for Lj, and e A+1 , . . ., e n a basis for L t . Then the matrix of the operator A 
is quasi-diagonal: 

Hlon.ll- 

Partition the matrix B e of the operator B thus: 


From the condition A e B e — BgA e = 0, we obtain 

A11B12 — BjjAjj = 0, A22B2} — ^21^11 = 0. 


Now, it follows from 6.3.49 that Bj, = 0, B t j = 0. 

6.3.51. If A is similar to a triangular matrix B, then A p is similar to the 
triangular matrix B p . 

6.4.12. The basis for the root subspace for X = 0 is the vector (0 1 —l) 71 . 
The basis for the root subspace for X = 1 is formed by the vectors (1 0 l) r and 
(0 1 0 ) T . 

6.4.13. The only eigenvalue is X = 1. The root subspace coincides with the 
three-dimensional arithmetic space. 
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6.4.14. The basis for the root subspace for X = 2 is made up of the vectors 
(2 —1 0 0) T , (10 1 0) / ’, (2 0 0 1) T . The basis for the root subspace when 
X = — 2 is the vector (0 10 —1) T . 

6.4.15. The basis for the root subspace when X = —1 is formed by the vectors 
(110 0) T , (0 0 1 1) T . The basis for the root subspace when X = 1 is formed 
by the vectors (3 1 0 0) 71 , (0 —2 3 1) T . 

6.4.17. (a) Assume that the vector ( A — XjE ) x has height k, k < h. Then 
(A — X t Ef (A — XjE) x = 0 = (A — XjE) (A — X t E)*x. 

Thereby, the nonzero vector (.A — XiE) h x is an eigenvector associated with the 
eigenvalue Xj, X } X it which is impossible since the root subspaces intersect 
only in the zero vector; 

(c) as with (b), show that for any number a other than X t , the height of the vec¬ 
tor (A — aE) x is the same as that of the vector x. 

6.4.22. The transpose of the Jordan block of order n for the number X 0 . 

6.4.23. The canonical basis can comprise, for example, the vectors e 1 = 
= (4 3) r , e 2 = (0 if. The Jordan form is as follows 



6.4.24. e , = ( i ! _i)T 

<>, = (_4 -5 6) t , /= 

e , = ( 0 0 i) T ; 

6.4.25. , i = (1 _ t 0 0) T 

e s = (0 1 -1 0) T . j 

Cj = (0 0 1 -if. 

e 4 = (0 0 0 1) T ; 


1 ° 1 0 II 
0 0 1 . 

0 0 o|| 

1 2 1 0 Oil 
0 2 10 
0 0 2 1' 
0 0 0 2II 


6.4.26. e, = (l 1 1 1 1) T , 

e* = (3 2 1 0 -1) T , 

e 3 = (3 1 0 0 if, 

c 4 = (l 0 0 0 -if, 

*» = (0 0 0 0 1) T ; 

6.4.27.11-1 1 0 0... 0 Oil 6.4.28.111 1 0 0... 0 0 

0 -1 1 0 ... 0 0 0 1 1 0 ... 0 0 

0 0 -1 1 ... 0 0 0 0 1 1 ... 0 0 


« 0 0 00...—1 ill II0000...11 

0 0 00 ... 0 - 1 II || 0000...01 

6.4.29. II9 1 0 0...0 Oil 6.4.30. Ill 1 0 0...0 0 

0 9 1 0 ... 0 0 0 1 1 0...0 0 

0 0 9 1...0 0 0 0 1 1...0 0 


0 0 0 0 ... 1 1 
|o 0 0 0 ... 0 1 


110 0 0 
0 110 0 
0 0 110 
0 0 0 1 1 
0 0 0 0 1 


0 0 0 0 ... 9 1 

0 0 0 0...0 9 
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2 10 0 .. 
0 2 10 .. 
0 0 2 1 .. 


0 0 0 0...2 1 
II 0 0 0 0...0 2 



6.4.33. The Jordan form is the Jordan block of order n + 1 corresponding 
to zero. The canonical basis is 1, t, t*, • • <"• 

6.4.39. Both are equal to (A. — X g ) n , n being the dimension of the space. 

6.4.40. If 


a, (A - X 0 E)h *i + . . . + ol p (A - X 0 E)^ Xp = 0, 

then 

(A - X 0 E) h (a 1 x l + . . . + ctpxp) = 0, 


whence (since k <t) 

a,z, + . . . + o-pXp = 0, 


* * Now, let' y = etj (A — + . . . + a„ (A - A 0 £)% 6 H t . h . v 

Then 

0 = (A — X g E)i-*- l y = (A — XpE)*- 1 (a lXl + . . . + a pX v <- 

Therefore 

ai*i + . . . + a p x p = 0 

and otj = . . . = a p = 0. 

6.4.42. Applying the operator (A — A 0 E)*~ l to both sides of the equality 


a 1 x 1 + . . . + «pZp + Pi (A — X 0 E) *i + . . . + P p (A —X g E) x p + . . . 


. . . + Yl (A - + • • ■ + V P (A - KE)t-'x p = 0 (a), 

we obtain 

(A - X 0 E)t- 1 (a,x, + . . . + apxp) = 0, 

whence Oj = . . . = a p = 0. Similarly, applying the operator (A — X 0 £)<-* 
to (a), show that p, = . . . = = 0, etc. 

6.4.44. A canonical basis is, for example, and the Jordan form 


e, = (—2 2 1 2) t , 

e* = ( 0 0 1 1) T , 

e s “ ( 1 2 1 -1) T , 

e 4 = ( 1 1 0 0) T ; 

e, = ( 0 0 101 0) T , 

e, = ( 0 1 0 0) T , 

e 3 = (101 0 0 0) T , 

*« = ( 0 0 0 1) T ; 


! 1 1 0 Oil 
0 10 0 
0 0 11' 

0 0 0 11| 

! 99 1 0 Oil 

0 99 0 0 
0 0 99 1 

0 0 0 991 


6.4.45. 
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6.4.46. 

e,=( 1 2 1 0 0 0) T , 

e 2 = (— 2 -3 -1 0 0 0) T , 

e, = ( 1 0 0 0 0 0) r , 

e 4 = ( 0 0 0 1 2 1) T , 

e 6 = ( 0 0 0 1 1 0) r , 

«. = ( 0 0 0 1 0 0) r ; 

6.4.47. 



e, = (0 0 0 0 -1 0) T , 

e s = (l 0 0 0 0 Of, 

e 3 = (0 0 0 -3 0 0) T , 

« 4 = (0 1 0 0 0 Of, 

«5 = (0 0 0 0 0 — 5) T , 

«, = (0 0 1 0 0 0) r ; 


2 1 0 0 0 0 
0 2 0 0 0 0 
0 0 2 1 0 0 
0 0 0 2 0 0 
0 0 0 0 2 1 
0 0 0 0 0 2 


6.4.48. The Jordan form consists of two Jordan blocks of order ft corre¬ 
sponding to zero. A canonical basis could be, for example. 


■ IT* 


t s, . 


6.4.50. n = (m t < + 2 m,-m, t ) (t-l> = p,t + (p 2 — #»,)<*—*1). 

Ihe Jordan form consists of Pi blocks of order t and p 2 — p, blocks of order 


‘,=(1 -2 

if, 

II 

« 2 = (1 0 

0) T , 


= 

e 3 = (0 1 

-i) T ; 

1 

«.=(! 1 1 

D r . 

II 

« 2 = (1 0 0 

0) r . 


- 

«, = (0 1 1 

0) r , 


e 4 = (0 0 1 

-i) r ; 

II 

«j = (24 0 0 

0 0) r , 


- 

e 2 = ( 5 7 8 

0 of. 



e, = ( 0 0 0 

0 if. 

J = 


e 4 = ( 4 6 0 

0 of. 



', = ( 0 0 0 

1 0) r : 




llo 0 3II 

1 4 1 0 Oil 

0 4 0 0 

0 0 4 0 

0 0 0 4 I 
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6.4.54. e t — (1 11 1 1) T , 

e 2 = (0 -1 0 0 0) T , 

e 3 = (1 1 0 1 1) T , 

e 4 = (0 0 0 -1 0 ) T . 

e t = (0 0 0 0 1) T ; 



6.4.55. The Jordan form consists of two Jordan blocks corresponding to zero, 
one being of order k + 1, and the other of order k. A canonical basis could be, for 
example, 


ir' 1 ’ tH 4 . •••• ■ 


r t 2 *, t, . 


6.4.56. The Jordan form consists of p, blocks of order t, p, — p 4 blocks of 
order t — 1, and in general, p t -h + i — p t . h blocks of order k, 0 < k < t. 
6.4.58. No; otherwise 


6.4.59. e, = (2 2 
e, = (0 1 
e, = (0 0 
e 4 = (l 0 

6.4.60. e, = (—3 

e , = (-2 

*a = ( 1 

e 4 = ( 1 

** = ( 1 


m 4 

— 2 
1 
0 
0 

1 1 
0 1 
0 0 
0 0 
0 0 


— m a = 2 > m» — m, = 1. 

- 2 ) t , 111 1 0 0 

0) T , /= 0 1 1 0 
1) T , 0 0 10 

1)T; II0 0 0 1 

1 i) T , II-1 

1 D T . 0 

0 0 ) T , /= 0 


0 

0 

0 


0 


0 

0 


0 

0 

0 

-1 

0 


0 

0 

0 

0 


e i = (24 —12 0 0 

e 4 = ( 6 0-2 8 

— ( 1 0 0 3 

e 4 = ( 0 0 0 1 

e s =( 3 0-1-8 

«„ = ( 2 0 0 -3 

*i =■ (— 2 0 2 0 2 0) T , 

e.-( 0 0 0 0 2 Of, 

r 3 -( 1 0 0 0 0 Of, 

e,~{ 0 0 0 3 0 1) T , 

fi = ( 0 0 0 1 0 0)^, 

«. = ( 0 1 0 0 0 0) T ; 


0 of, 

-4 Of, 

0 -1) T , J = 

0 0 ) T , 

4 0) r , 

0 1 ) T ; 


0 1 0 0 0 0 
0 0 1 0 0 0 
0 0 0 1 0 0 
oooooo 
0 0 0 0 0 1 
oooooo 


2 1 0 0 0 0 
0 2 1 0 0 0 
0 0 2 0 0 0 
0 0 0 2 1 0 
0 0 0 0 2 0 
0 0 0 0 0 2 
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6.4.63. e, = (— 2 2 2) r , 11—2 1 Oil 

••-( 1 1 -') T ' H ° - 2 ° • 

e a = ( 0 1 l) r ; II 0 0 3l| 

6.4.64. e,= ( 11 Of, 112 0 Oil 

*«=( 0 1 *> r . '= ° 2 0 . 

<?, = (-l 2 2) t ; II0 0 31| 

6.4.65. e, = (— 4 -3 -4) r , 111 1 Oil 

'«“( 2 2 -I)'. 0 . 

e, = ( 1 0 l) r ; HO 0 21] 

6.4.66. e, = (1 -1 2 f. 111 1 Oil 

e t — (0 0 -if, /= 0 1 1 . 

e a = (0 1 0) T ; II0 0 ill 

6.4.67. e, = ( 3 3 -3 -3) r , 

** = ( 1 0 -1 0) T , j 

= (— 3 -3 -3 — 3) r , 

e 4 = ( 1 0 I 0) T ; 

6.4.68. e, =( 2 1 0 0) T , 

e 2 = ( —21 -10 0 Of, 

«a = ( 0 0 3 —2f, 

e 1 = ( 8 3-1 1) T ; 

6.4.69. e, = ( —2 — 1 0 0) T , 

«* = ( 1 0 -2 3) r , y 

««-( 0 0 1 0) T , 

e 4 = ( 0 0 0 1) T ; 


0 1 0 0 

0 0 0 0 

0 0—1 O' 
0 0 0 -1 


-1 1 0 0 

0—1 10 
0 n _1 0 • 

0 0 0 0 


2 1 0 0 

0 2 0 0 

0 0-2 1 
0 0 0 -2 


6.4.70. e, = (2 -2 2 -2) r , 
e t = (i 0 1 Of, 

e 3 = (0 -1 0 if, 

e 4 = (0 0 1 — 1) T ; 


3 10 0 

0 3 0 0 

“ 0 0 3 O' 

0 0 0 —2 


6.4.71. Each block is replaced by its transpose; the order of the blocks on 
the principal diagonal is reversed. 

6.4.72. The diagonal elements X lt . . ., ^ of the Jordan form of the opera¬ 
tor A are changed to ^ — X„, .... X„, — X, in (a), and to 1/X,, . . ., 1 in 
(b). 

6.4.75. The Jordan form of the operator A * can be obtained from that of the 
operator A as follows: replace X by X* in each block corresponding to X 0; 
replace each block of order k corresponding to 0 by two blocks of order l if k = 21, 
and by two blocks of orders 1+1 and 1, respectively, if k = 21 + 1. 
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6.4.77. It follows from the condition A* = E that the eigenvalues of the ope¬ 
rator A can only be equal to 1 and —1. Verifying the equality /* = E for the 
Jordan form of the operator A, we find that / is a diagonal matrix, i.e. A is an 
operator of simple structure whereas both 1 and —1 must be the eigenvalues of A, 
otherwise A = —E or A = E. Denoting the eigensubspaces of the operator A 
associated with 1 by Ly and L t , respectively, we obtain that A is a reflection 
operator in parallel to L t . 

6.4.79. The defect of the operator A — X 0 E can be found using the matrix 
J — XqE, where J is the Jordan form of the operator A. Using this matrix each 
block of J corresponding to X 0 is transformed into a block of / — X«E corre¬ 
sponding to 0, the defect of the latter being equal to unity. The other blocks of 
J — X 0 E are nondegenerate, and thus the defect of / — X 0 E equals the number 
of Jordan blocks of J corresponding to X 0 . 

6.4.82. 1 1 0 0 0 6.4.83. 1 1 0 0 0 

0 1 1 0 0 0 1 1 0 0 

0011 0. 001 0 0. 

0001 0 000—1 1 
0C0O-1 000 0 -1 

6.4.84. 5 1 0 0 0 0 6.4.85. 2 0 0 0 0 0 

050000 020000 

005100 00-4100 

000500- 00 0-4 1 O' 

0000 13 0 00 0 0 -4 0 

00000 19 00 0 00 -4 

6.4.86. 1 1 0 0 0 0 6.4.87. 1 1 0 0 0 0 

010000 011000 

001100 001000 

000110- 000110* 

000011 000011 

000001 0 0 0 0 01 

6.4.88. The Jordan form consists of one block of order re + l corre¬ 
sponding to zero. 

6.4.89. The Jordan forms of both the operators coincide and consist of three 
Jordan blocks of order 3 corresponding to zero. 

6.4.91. There is not a single pair of the matrices A, B and C that contains 
similar matrices. 

6.4.92. A and C are similar to one another and not similar to B. 

6.4.93. A and B are similar to one another and not similar to C. 

6.4.95. If X is an eigenvalue of A not 1 or —1, then MX is also an eigenvalue; 
moreover, to both eigenvalues there corresponds the same number of Jordan 
blocks of respectively equal orders. 

6.4.98. Only one Jordan block in the Jordan form can correspond to each 
eigenvalue. 

6.4.100. Write a quasi-diagonal matrix of order nm whose diagonal is the 
matrix J repeated m times. Then the Jordan form of the matrices A X B and 
A X E n + E m X B is obtained as follows: (a) for each nonzero eigenvalue X t 
of A, multiply the diagonal elements of the i-th block of J by X t ; and if X t = 0, 
then the corresponding block of J is replaced by the zero matrix; (b) add Xt 
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to all the diagonal elements of the Mh block of J. The Jordan form of the op¬ 
erators G ab and Fab, respectively, is obtained in the same way. 

6.4.101. If a is the n-th primitive root of unity, r= y' e, then the Jordan 
form of A is as follows: 


1 + r 0 

1-r ra 

t + ra 2 

0 1 + ra"- 1 


7.1.6. If A is a diagonal matrix such that X (( = (e t , e t ), then 
(A*) e = A-i (A e )* A, 


where ( A e )* is a matrix conjugate to A e . In particular, if the lengths of all the 
vectors e t are the same, then (A*) e = (A,)*. 

7.1.7. For elements a l} of the matrix A e of the operator A, the equalities 
must hold 

a U = ( Ae J> h)’, 

similarly, for elements a*} of the matrixJA^ of the conjugate operator A*: 


°Tj = ( A 'fj, e,). 

Therefore __ 

a i, = a Jl‘ 


7.1.8. Any operator on a one-dimensional space multiplies each vector in 
the space by a fixed (for the given operator) number a. If the space is unitary, 
then the conjugate operator multiplies by the conjugate number a. Any opera¬ 
tor on a Euclidean one-dimensional space coincides with its conjugate. 

7.1.9. Rotation through the angle a in the opposite direction. 

7.1.10. A* = -A. 

7.1.11. (a) 110 1 Oil || 0 0 0 || 

0 0 2 , 1 0 0 ; 

II 0 0 01| || 0 2 01| 


(b) 


-3 -4 -1 
1 0 -1 , 
1 4 3 


-1 1 1 
0 0 0 
-1 —1 1 


(c) 0 10 

0 0 3 
0 0 0 
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7.1.12. (a) 0 

-4 0 

(b) 11-3 1111 

(C) 0 

-2 0 

3 

0 1 


3 - 

•o 1 

2 

2. 

0 T 

0 

6 0 


0 

4 0 


7.1.13. (a) NO 

-5/2 on 

(b) -3 

2 2 (c) 110 0 Oil 

3 

0 15 

5 

n 5 . 300 

II 0 

15/2 0 II 

4 

4 ’ || 0 5 o|| 



— 2 

—2 3' 


7.1.19. In the complex case = tr (A JB). 

7.1.20. If e lt . . ., e n is an orthonormal basis for the space X, then the vec¬ 
tor/ is_one whose coordinates with respect to this basis are the numbers/"(cO, . . . 

7.1.^5? A* is the projection operator on the plane x + y + z = 0 parallel 
to the axis Oz. 

7.1.26. (a) The basis for the kernel is the polynomial I s , and the basis for 
the image is made up of the polynomials t and i a ; (b) the basis for the kernel is 
the polynomial 3 i 1 — 2, and the basis for the image consists of the polynomials 
t and 3i* — 2; (c) the basis for the kernel is the polynomial 3<* — 1, and the basis 
for the image contains t and 3i* — 1. 

7.1.32. The inclusion T A + B <z T A + T D is always fulfilled. Show that for 
the data given, T A + B = T A + T B , for which it suffices to show that T A c: 
<= T a+b and T b <z T a + b . 

Let x g T b *; then Ax = 0 (by the condition AB* = 0) and (A +/?)* = 
= Bx. If x ranges over T B *, then Bx ranges over T B ; thus, T B <=. T A + B . In the 
same way deduce that T A cz T A + B by rewriting the condition AB * = 0 as 
BA* — 0. 

By the second condition in the problem and Problem 7.1.31, the sum T A+B = 
= t a. + t b is orthogonal. Therefore 

r A*B = r A + r B• 

Similarly, it can be shown that Ti a+B) * = T A * + T B *, whence by trans¬ 
ferring to the orthogonal complements, we obtain the second statement of the 
problem. 

7.1.34. The null subspace and spans of the sets of polynomials t h , <*♦’, . . . 
.... t n (k= 0, 1 , . . ., n). 

7.1.35. The required subspace is determined by the condition 

S / (*) = 0. 

h =0 

7.1.36. The required subspace is determined by the condition 


( /(<)* = 0. 

-l 

7^1.39. (a) 1, t, <*; (b) 1/^3, t/ 1/2, (3t*-2)/l/ r 6; (c) 1//2, YWt, 

1 ^ 578 ( 3 / 2 — 1 ). 

7.1.41. If A*, 7^ are the eigenvalues of the'operator A, then the eigen¬ 

values of the operator A* are 
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7.1.44. Let k be the dimension of K k . Then for any vector x from K^‘- (A — 
— XE) h x = 0. If y is an arbitrary vector from K J then 

0 = ((A - XE)h x, y ) = (i, (A* — XE)* y). 

The operator A* — XE is nondegenerate on the invariant subspace K J. There¬ 
fore the obtained equality means that J_ K*. 

7.1.45. The Jordan form of the operator A* is obtained from the Jordan form 
of A by replacing the diagonal elements with the conjugate complex numbers. 

7.1.46. A canonical basis for the differential operator can be constructed, 
for example, by the polynomials 2. 2 1, t 2 ; a canonical basis for the conjugate 
operator by the polynomials t 2 , til , 1/2. 

7.1.47. Let the given order of the eigenvalues be as follows X^, X /a , . . ., X Jjl( 
and let it be required to construct an upper Schur form. Then^take the normed 
eigenvector of the operator A *, associated with the eigenvalue X ln , as the vector 
e n and consider both the operator A x induced on the orthogonal complement to 
e n which is A-invariant, and its conjugate A*. Take the normed eigenvector Af 
associated with X (n _, as and then consider the orthogonal complement to the 
span of the vectors e n _, and e„, etc. The construction may also be performed “in 
tne reverse order": select the normed eigenvector of A associated with X ti as 
the vector e x and then consider the orthogonal complement of e x which is A*- 
invariant, etc. 

7.2.20. This statement about a Euclidean space does not hold. Any operator 
which has no eigenvalues and is not normal will serve as a counter-example. 

7.2.22. Yes, it follows. 

7.2.29. No, if all the eigenvalues of the operator are of multiplicity unity; 
yes, if at least one of them is multiple. 

7.2.30. Xj = 1 + i. X, = 1 — i. A basis could be, for example, the vectors 

“7T ,i -*>'• 

7.2.31. Xi=0, X 2 = 3i, X 3 = — 3«. A basis could be, for example, the 


-j-3i 2— Of 5) . 

7.2.32. Xi = -l, Xi = 2— 


! " 2 -*>' 


7.2.33. X, =2, Xj = — 2, X 3 = 2i, X 4 =-2 i. The basis is e,= 

—jp|-(« 1 0 0) T , e s = (0 0 1 —1) T ; e 3 = -y(f -1 i ,) T , e,= 

= \ (1 -1 ~i -if- 

7.2.34. No. The differential operator is not an operator of simple structure. 

7.2.35. No, if a # 0. When a = 0 the identity operator is obtained. 

7.2.37. If x = (a,, o 2 , a 3 ) and y = (P,, p 2 , p 3 ) are arbitrary vectors from 

J? 3 , then the scalar product can be given by the formula 
(x, y) = a,P, + OiP 2 + a,p 3 + o 2 P, + 2a 2 p s 

+ 2a2$3 + O3P1 + 2o 3 p s + 3a 3 p* 
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= —f=- (1 1 l) T , e,= -4^-( 1-- 
1/3 1/3 V 

_i._ i j/l_1 ■ t 1/3 \ T 


7.2.42. For example, *, = -i|-(l -2 l) T , e 2 = —L-(l 0 -1) T , e 3 = 

=T7T"“ ,r - 

7.2.44. Let all the eigenvalues of the operator A be different in modulus 
I X* | > | A, | > . . . > | |, and let «i, . . ., be the corresponding ortho¬ 

normal eigenvector basis. The matrix of the operator AB with respect to this 
basis is normal and equal to the product of the matrices A, and B e . Equalizing 
(in accordance with 7.2.12) the sums of the squares of the moduli of the elements of 
the first row to those of the first column of the matrix AgB t , we obtain 
I Aj I 1 ([ 1 1 * -L |!>i 2 1 2 + • • • ~ l^m 1*) = I A, |*|&n | 2 + | Aj| |6 ji |*t •. • HA„||6„.|* 


These equalities are all true only if 

6j, = . . . = b nl = b,* = ... = b in = 0. 

Similarly it can be shown that all the other off-diagonal elements of the matrix 
B e are zeroes. Thus B e is diagonal matrix, and therefore the operators A and B 
commute. 

7.2.45. Reasoning in the same way as for the proof of 7.2.44, show that the 
matrix of the operator B is quasi-diagonal with respect to the orthonormal eigen¬ 
vector basis of the operator A (if it satisfies the conditions of the problem), and 
that its diagonal blocks of order >1 correspond to multiples of the eigenvalues 
of the operator A. Hence the matrices of the operators commute. 

7.2.47. Any vector for which this maximum occurs is an eigenvector of the 
operator A associated with the eigenvalue with maximum modulus. 

7.2.49. No. For example, for a unitary operator V, the ratio | Ux |/| x | 
equals unity for any nonzero vector x. 

7.3.4. The operators of multiplication by a number whose modulus equals 
unity. 

7.3.6. No. The operator A is degenerate. 

7.3.8. (a) Yes; (b) no. 

7.3.10. No, if the operator is not the identity operator. 

7.3.12. (a) The eigensubspace for A = 1 coincides with the set of all even poly¬ 
nomials and the eigensubspace for A = —1 coincides with the set of all odd poly¬ 
nomials; (c) the eigensubspace for A = 1 is drawn on the set of polynomials 
t n + 1, t"- 1 + t, . . ., and the eigensubspace for A = —1 is drawn on the 
polynomials t n — 1, t 1 *- 1 — t, . . . If n = 2k — 1, then both the subspaces 
are of dimension k; if, however, n = 2k, then the dimension of the first is k + 1 
and of the second k. 

7.3.13. The scalar product of polynomials f (t) = a 0 + and 

S (0 = b 0 + b,t + 6 2 t* may be evaluated by the formula 

(/, g) = 3Of,b 0 — 2 a„bi — 2 a 0 b t 

—2o 1 6„ + 2ax6! + ajfc, 

—2 a t b 0 + a t bi + 2 a t b 2 - 


1/2 20-0619 
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7.3.18. Yes, it is. 

7.3.21. Let A be the given operator and let e x , . . e„ be an arbitrary or¬ 
thonormal basis. By the data, tne vectors Ae lt .... Ae„ are orthogonal each 
to each. Show that they have equal length. If, for example, a, = | Ae 1 | # 
# a, = | Ae t |, then the vectors e x + e t and e t — e, are orthogonal, and A (<? x + 
+ ft) and A (e 1 — <•,) are not: 

(A (e x + <>,), A (e x — e,)) = (Ac x , Ae x ) — (Ae t , Ae t ) = af — aj. 
Therefore | Ae t | = a for all l = 1, . . -, n, and then A = aU, where U is a 
unitary operator transforming the vectors e t into the vectors (1/a) Ae t . 

7.3.34. Interchanging the rows and columns of a matrix in the reverse order 
is a unitarily similar transformation. 

7.3.37. -1|;, = (<|), -1|> 4 ) + 2kn. 

7.3.38. tfj = -* 3 = arg a u - arg a )t , 

l«il I \ a )i\ 

coscp = — , . _ , sin q - - . 

1/l««l i +l«yil* 1/ 

7.3.40. Multiply the given matrix A on the left by the sequence of elementary 
unitary matrices T lt , T u , . . ., T tn , T ti , . . _ x .n so as to make all the 

subdiagonal elements equal to zero one by one. The derived upper triangular 
matrix is one of the factors of the required decomposition, and the other is the 
product 77,7’f 3 , . . ., 7’S. X ,„. 

7.3.44. The length of the vector w must be equal to unity. 

7.3.46. The eigenvalues equal 1 and —1. Moreover, \ = —1 is an eigenvalue 
of multiplicity unity, and its corresponding vectors are collinear with w. The 
eigenvectors for X = 1 (and the zero vector) make up the orthogonal complement 

7.3.47. The determinant equals —1. 

7.3.49, w = (-sin^-cos-|-) r . 

7.3.50. The product Hx should be evaluated by the formula 

IIx = i — 2 (x, w) w. 

The scalar product (x, w) is computed by (7.1.4). 


7.3.51. w = r 


: (x — Ae x ), v 


e | k | = | x | = (x, xyr-, as to the 


' | x — ke x | 
rest, the choice of k is arbitrary. 

7.3.52. In accordance with 7.3.51 select the matrix ff x so that for the given 
matrix A of order n, the matrix i4 x = H^A x may be of the form 


such that Ai is a submatrix of order n — 1. Now construct the matrix H t : 
111 0... Oil 
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where H % is a reflection matrix of order n — 1 selected so that all the'subdiagonal 
elements of the first column of the matrix H t A\ are zero. The first two columns 
of the matrix H t H\A will now coincide with the columns of a triangular matrix. 
In a similar way after n — 1 steps an upper triangular matrix is obtained. 
The unitary factor of the required presentation is the product HiH t . . . H n -i 
7.3.54. If the column vector (a sl a 3l ... a nl ) T ^'denoted by a,, then a matrix 
of the form 



may be taken as H, where H is a reflection matrix transforming a, into a vector 
collinear with the unit column e, of order n — 1. Moreover, /f^is itself also a re¬ 
flection matrix. 

7.3.55. For any operator there exists an orthonormal basis for thejspace with 
respect to which the matrix of this operator is upper (lower) almost triangular. 

7.4.7. In the complex case, these are operators of multiplication by a real 
number. All linear operators on a one-dimensional Euclidean space are symmetric. 

7.4.11. Yes. 

II 17 5 _1 II 

7.4.15. S e «=l 5-7 5 L 

II-1 5 171| 


7.4.24. H = 0. 

7.4.34. Let L h be an arbitrary Ar-dimensional subspace. Consider the span 
M n _), + i of the vectors e h , together with L k . The intersection of L h 

and M n -k+i is at least one-aimensional; let i 0 be a nonzero vector from this 
intersection. Then according to (7.4.3), 


Therefore 


so that also 


*o) 
(*o. *o) 




(Hx , 

nun -2- 

xqfcO (*. * 
xtL h 


x min (Hx ' x) < 

' (*. x > 


That the equality in the relation (7.4.4) occurs is demonstrated by the Ar-di¬ 
mensional span of the vectors «i, .... e k . 

(7.4.5) is proved similarly. 

7.4.35. Without loss of generality, the submatrix H n . t may be assumed to be 
in the upper left-hand corner of the matrix H. Let / x , . . ., be an orthonormal 
basis of tbe eigenvectors of the matrix H n - x associated with (J. x , . . ., pn-x, 
respectively, where pi >- p* >-. . . > p n -i- According to (7.4.3), 


(H n-iy. y) 

(y< y> 


= Ffc = 


(^n-1 y. y) 
(y, y) ’ 


1/9*0 

l/EA? n _ 
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where M * is drawn on /,, . . /*, and M n . h on f h , . . / n _j. Now, match each 

(n — l)-dimensional column y with an n-dimensional column vector x such that 


Then 



(Hn-iU- y) (Hx. x) 
( y . y) (*. 


for the corresponding vectors y and x. To the subspaces M n _ k and there 
correspond, in the n-dimensional space, M n .h and M h of the same dimension. 
Therefore, it follows from the Courant-Fischer theorem that 


Xft+i < ^ < X*- 

7.4.36. One positive and one negative eigenvalue. 

7.4.40. For any Hermitian operator, there is an orthonormal basis for the 
space with respect to which the matrix of this operator is tridiagonal. 

7.4.42. /, (X) = 1, /, (X) = X, /, (X) = X* - 1, /»(X) = X» - 2X, /« (X) = 
= X' - 3X* + 1, /, (X) = X‘ - 4X» + 3X. 

7.4.44. Use the induction method over the number of polynomials in the 
set /o (X), /i (X), . . ., f k (X). Let A = 1. Then (p) is greater or less than zero 
according as the number p is greater or less than the unique root X; 11 of the poly¬ 
nomial h (X). In the first case, the sequence 


/« W = 1. fi GO 

has no sign changes, and in the second it has. 

Assume that tne proposition in the question is true for all A < r. The values 
of the polynomials f T (X) and / rtl (X) at the point p may then be calculated by 
the formulae 


1r GO - fi fr*i G0= fi'(Ii-X^ n+1> ). 

;=l i=l 

Hence the sign of each of the numbers f r (p) and /,.+• (p) is determined by the 
number of negative brackets in the corresponding product. The number of roots 
of the polynomial f rti (X) occurring to the right of the point p is equal to, or one 
greater than, that of tne polynomial f r (X) (see 7.4.43 (b)). In the former case, 
the sign of f Ttl (p) coincides with that of / r (p), and the sequence 

to GO, fi GO. fr GO. /rtl GO 

has the same number of the sign changes as the sequence 

/o GO, h GO. - . •• fr (p). 

In the latter case, the signs of / rt . (p) and f r (p) are opposite, and in the first se¬ 
quence there is one more sign change than in tne second. 

7.4.45. The proof, as in 7.4.44, uses the induction method. First, let A = 1. 
If p = X<|>, then the same sign as of /„ (p) = 1 is ascribed to the zero value of 
fi (p) and the sequence 

, /o GO. /i(p) 

has no sign changes. 

Now, let the statement be true for all A ^ r. If p is not a root of the polyno¬ 
mials j r (X) and f r+ i (X), then the induction follows as in proof of 7.4.44. Con¬ 
sider the two remaining possibilities: 
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S p is a root of the polynomial / r fX). Then by problem 7.4.43 (b), the num- 
roots of the polynomial / r+1 (X) lying to the right of p is one greater than 
that of / r (X). The numbers f r+1 (pi) and f r _ r (p) have opposite signs and there is 
one more sign change in the sequence 

/. 0*). /l ft*). fr -1 ft*), fr ft*), /r-1 ft*) 

than in the sequence 

/. ft*), /i ft*). fr -1 ft*), fr ft*); 

(b) p is a root of the polynomial / r « (X). In this case, the rule described above 
to ascribe a sign to a zero value is usea, and so the indicated sequences both have 
the same number of sign changes. In addition, both the polynomials f r (X) and 
/ r+1 (X) have the same number of the roots lying to the right of p. 

7.4.46. Let S (z) be the number of sign changes in the sequence of numbers 

/o (x), h (x)./„ (x). 

According to the condition S (a) > k, S (6) < k. Put c = - ^ and set up 

the sequence 

fo ft), h ft) ft). 

If S ( c ) >- k, then X* lies in the interval (c, 6). If, however, S (e) < k, then 
either X A = c or X h lies in the interval (a, c). 

7.4.49. The required approximation to ^ is 27/16. 

7.4.52. (b) Any real symmetric matrix is orthogonally similar to a diagonal 
matrix. 

7.5.1. No. 

7.5.20. Let X be any eigenvalue of the matrix A and z the corresponding 
eigenvector. Then 

0 > (Cz, z) = (A*Bx, z) + (BAx, z) = (Bx, Ax) + (Ax, Bx) 

= (F+ X) (Bx, z) = 2 Re k-(Bx, z), 

whence Re X < 0. Now, the uniqueness of the solution of the Lyapunov equa¬ 
tion for the matrix A follows from 6.3.49. 

7.5.21. H = 0. 

7.5.26. The proposition in the problem follows from 7.4.19 and 6.3.51. 
7.5.28. The proposition in the problem follows from 7.4.20 and 6.3.48. 
7.5.30. The matrix S is the Schur product of the positive-definite matrices // 
and H t . 

7.5.36. The necessary condition follows from 7.5.9. Now, let the matrix H 
fulfil the Sylvester criterion. Prove by induction that the leading principal sub- 
matrix H h is positive definite. 

For k = 1 it is obvious. Further if fl h is positive definite, then the eigenval¬ 
ues p, > . . . > p h of this matrix are positive. It follows from 7.4.35 that at 
least X,, . . ., X h of the eigenvalues Xj > . . . > X* X h+1 of the submatrix 
h h+1 are positive. But in view of the condition del > 0, X fc+1 is also posi¬ 

tive, hence H k +i is positive definite. 

7.5.39. The matrix is not positive semidefinite. 7.5.40. The matrix is not 
positive semidefinite. 7.5.41. The matrix is positive definite. 7.5.42. For any 
e > 0 the matrix H + e£ satisfies condition (7.5.2), therefore H is, at least, 
positive semidefinite. However, it can be shown that the determinant of the 
matrix H is positive by evaluating it using the iterative formulae which relate 
the principal minors in the lower right-hand corner. Therefore H is positive defini te. 
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7 - 5 - 46 - wium 

7.5.48. II 14 2 -4 
JL 2 17 2 


:::i 


7.5.49. II1 1 1 1II 

_1_ II1 1 1 i I 
2 1111 
||l 1 1 l|| 

7.5.53. It follows from H > S that SOPHS’ 1 !* > E, where S' 1 /* = 
= (S 1 /*)- 1 . Then, according to 7.5.33, S^H^S 1 /* < E or H’ 1 < S’ 1 . 

7.5.60. Let x be an orthonormal eigenvector -of the operator HS corre¬ 
sponding to the eigenvalue Yi- Then 

Vi = (HSx, x) = ( Sx , Hx) < | Sx | .| Hx | < o^. 

In the last part of the relation, relation (7.4.2) is used. 

7.5.61. fa) It follows from H = S + iK that iS~ l K = S’ 1 H — E. Since 

the eigenvalues of the matrix S’ 1 /! arc positive, the eigenvalues of the matrix 
iS^K are real and greater than —1. Note that S’ l K is similar to the skew-sym¬ 
metric matrix therefore its eigenvalues are placed symmetrically 

about zero. Hence the eigenvalues of iS’ 1 K are less than 1; 

(b) to prove the proposition it suffices to verify that del (S’ 1 !!) < 1. It fol¬ 
lows from (a) that the eigenvalues of the matrix S’ 1 /! lie m the interval (0, 2) 
and are symmetric about its midpoint. The product of each symmetric pair of 
the eigenvalues, 1 + x and 1 — x, docs not exceed unity, hence the required in¬ 
equality. When det S = del //, the matrix S~ l H equals the unit matrix; 

(c) it follows from (a) that | det (S' 1 if) I < 1 whence det K < del S. 

7.6.1. If a t , . . ., a 8 are the singular values of the operator A , then (a) A* 

has the same singular values; (b) aA has the singular values |a | Oj, . . . 

7.6.5. The singular values of A’ 1 are reciprocal to the singular values of A. 

7.6.8. n, n — 1.2, 1, 0. 7.6.9. 2*^ 1, 0. 

7.6.12. The columns of U make up an orthonormal set of the eigenvectors of 
the matrix i4i4*, and the columns of V* form an orthonormal set of the eigenvec¬ 
tors of the matrix A*A. 

7.6.16. (a) A ‘ = V‘ A V\ (b) A * = V*\U*\ (c) A’ 1 = (PK) *P\’ 1 P (UP)*, 
where P is the following permutation matrix: 

I ’ 0 

P = \ 


7.6.19. The unique nonzero singular value equals 
1=1 )=i 


e obtained from 7.6.23 if the unit column vectors 
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7.6.31. Without loss of generality, we can assume that A is in the upper left- 
hand corner of A, since this can be achieved by interchanging appropriate rows 
and columns which evidently leave the singular values unaltered. Lei] A be of 
the following partitioned form 



Then the matrix F = AA* + BB* is the principal submatrix of AA *, and its 
eigenvalues, enumerated in descending order, do not exceed the corresponding 
eigenvalues of .4.4*. Since BB * is a positive semidefinite matrix, the eigenvalues 
of A A* also do not exceed the corresponding eigenvalues of F. Hence the re¬ 
quired statement. 

7.6.34. Let L\ be a subspace of X such that 


Oh 


\ABx\ 
1*1 * 


Since 


^ \Rr\ ^ \Br\ 

Oh < ct, • mm ■ 1 < a, max min 1 ■ 

**0 1*1 L h x*=o 1*1 


If there is a nonzero vector x in the subspace Lh such that Bx = 0, then 6* = 0, 
and the inequality a ft < becomes evident. (Note that in this case p„ = 0 
also, so that the fourth inequality is also valid.) Otherwise the subspace BL% 
is of dimension k and for all nonzero vectors from 


\ABx\ \ABx | \Bx\ \A(Bx)\ 

1*1 1**1 ’ 1*1 " Pl 1**1 ' 






P, • min 

acsjfcO 

'€4 


\A{Bx) | a 

~\B7T^ r 


v¥=() 

VtBLl 


\Ax\ 

1*1 




The other two inequalities are proved in a similar way. 

7.6.36. All the possible products a,p. t l = 1, . . ., n, ; = 1, . . ., m. 

7.6.37. otj = a 2 = 2, a s = 1. 7.6.38. a, = 3, a 2 = 2, a s = 1. 7.6.39. 

a, = a 2 = 6, a s = 3. 7.6.40. a, = 9, a 2 _= o s = 0. 7.6.41. a, = a 2 = 5, 

« s = 3. 7.6.42. 04 = a 2 = 21/ 2, a, = \/ 2, a 4 = 0. 7.6.43. a, = a t = 3, 

«s = a 4 = 1. 7.6.44. aj = 4, a 2 =_a s = a 4 = 0. 7.6.45. a, = a 2 = a s = 

= a 4 = 2. 7.6.46. 04 = a, = 2 J/ 10, a 3 = a 4 = V 10. 

7.6.47. When n = 1 we obtain the trigonometric form of a complex number. 

7.6.48. H = (AM) 1 /*. 

7.6.49. It follows from the polar representation A = HU that AA* = H 2 , 
A* A = U*H 2 U. Let A Me, = U*H*Uei = a,e t . Then H 1 (Ue,) = a\ (Ue,). 
Q.E.D. 


7.6.53. Hx = (AM) 1 /*. 

7.6.54. If H and U commute, then A*A = AA* = H 1 , and the operator A 
is normal. Conversely let A be a normal operator, i.e. A*A = AA*, and let 




312 


Answers and Solutions 


e,, . . e n be the orthonormal basis of the eigenvectors of the operator AA*. 
The same vectors e lt . . e n are also the eigenvectors of the operator H, since 
A A* = H*, therefore 

(UH) e, = U (He,) = a,Ue„ t = 1 . n. (a) 

On the other hand, it follows from 7.6.49 that 

(Ue t ) = a\Ue t , i=l. n 

(HU) e, = H(Ue,) = a,Ue„ l = l . n. (P> 

The relations (a) and (p) show that UH = HU. 

7.6.56. H = -S, U = -E. 

7.6.57. If the matrix of the differential operator is considered with respect 
to the basis 1, t, < 2 , . . t n , then the operator H has a diagonal matrix^having 
elements 1 , 2, 3, . . ., n, 0 with respect to the same basis, and the operator U 
has the matrix 

« 0 1 0 ... 0 
0 0 1 ... 0 


0 0 0 ... 1 

±10 0 ... 0 


either a cyclic permutation operator: 1 -*• t n , t-*■ 1, <* —i 
n - 1 , or an operator both of cyclic permutation and of ri 


Thus, U 
.... t n - 
1 - -t’ 

7.6.58. A p = HpU p . 

7.6.59. A X B = (H X K) (U X V). 

-5 


7.6.60. H = 


1-5 i 

21/2 l/2 Oil 

l/2 3J/2 0 

0 0 51 | 


. 1/10 




1/2 

1/2 

171 

ITT 


3 10 0 

13 0 0 


1-12-2 

1 12 2 

0 0 3 1 

’ i/io 

-2 21-1 

0 0 13 


-2-2 1 1 


__ _ , __s a diagoi 

be the polar representation of the matrix P. The 

A = KUAU*K -* = (KUAU*K) (K- 1 )*. 


diagonal matrix, and let P =\KU 


Assuming H = KUAU*K, S = (if -1 )*, we obtain the required representation. 
7.6.64. Let A = UAV be the singular decomposition of the matrix A. Then 

tr (AW) = tr (UAVW) = tr (AVWU) = tr (A Z), 
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where Z = VWU and together with W ranges over the whole set of unitary 
matrices. It is obvious that 

| tr (AZ) | < otx + ... + a nt 

and the equality occurs when, for example, Z = E, i.e. W = V*U*. 

7.7.1. When n = 1 we obtain the ordinary form z = a + 16 of a complex 
number z. 

7.7.2. A = 0. 7.7.3. (a) A = B; (b) A * = B. 

7.7.9. A* = H 1 — iH % . 

7.7.20. The equality | det A | = det 77, occurs if and only if A = 7/,. 
7.7.23. S=-i-(A + A*), 7 <=±-(A-A*). 

7.7.25. A is a skew-symmetric operator. 

7.8.4. If the polynomial g (t) is represented in the form g (t) = at n + 
+ 8n-i (0. where g n _, (t) is a polynomial of degree < n — 1, then the pseudo¬ 
solutions of the equation Af = g are pre-images of the polynomial g n _, ( t ), 
i.e. all its antiderivatives. The normal pseudosolution is the antiderivative 
with the free term equal to zero. 

7.8.5. If the plane of the pseudosolutions of the equation Ax = 6 is given 
in the form x = x 0 + N A , where x# is the normal pseudosolution, then for (a), 

(b) , (c) the corresponding planes are: (a) x = — x« + ; (b) x= ax 0 + 7V A ; 

(c) x = x« + ^ 4 . 

7.8.6. Let x 0 be the normal pseudosolution of the equation Ax = 6. Then: 
(a) x„ is the normal pseudosolution of the equation UAx = Ub; (b) V*x B is the 
normal pseudosolution of the equation AVx = b. 

7.8.7. Let r be the rank of the operator A, and let the eigenvectors e u . . ., e r 
be associated with nonzero eigenvalues X,, .... X r . If 

b = a,*! + . .. + a T e r + a r ^e^i + . . . + a n e n , 
then the pseudosolutions of the equation Ax = b are vectors of the form 

x=-^~ *! + ... e r + Pr+i e pfl+ • • • +P»en. 
where P r+1 , . . ., P„ are arbitrary numbers. The normal pseudosolution is 



7.8.10. x„ =* (0 0 Of. 7.8.11. x„ = (0 0) T . 

7.8.12. ,.-f(l 1 1 1) T . 7.8.13. x 0 =-^(l 2 f. 

7.8.14. x 0 = ~y~ (5 6) t . 7.8.15. x 0 = -l-(l 0 1) T . 

7.8.16. x # =4<l 0 1) T . 7.8.17. x,, = (l 1 0) T . 



7.8.19. The null operator from Y to X. 


21 0619 
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7.8.21. The effect of the pseudoinverse operator on M n _, is similar to that 
of the integration operator. Polynomials of the form at n constitute the kernel of 
the pseudoinverse operator. 

7.8.27. Let B = (A*),y. Then B is an n X m matrix in which 6 n = l/oj, 
6„ = l/a lt . . b TT = i/a,., and all the other entries are zeroes. 

7.8.32. Nonzero eigenvalies of the operators A and A * are reciprocal to 
one another. 

7.8.35. A* = U*H* = II\U\. 

7.8.45. The operators A and X are reciprocally inverse on the pair of the 
subspaces Ta * and 7\-i. 

7.8.47. The operator X must have the same rank as A. Consequently, the 
subspace Ta * is the image of this operator. 

7.8.49. In addition to the conditions in Problem 7.8.47, the equation (AX)* = 
= A X shows that the kernel of the operator X must be orthogonal to the sub¬ 
space Ta- Thus, the image and kernel of X coincide with the image and kernel 
oi A *, the operators A and X being reciprocally inverse on the pair of the sub¬ 
spaces Ta * and Ta and by 7.8.26 X = A*. 

In Problems 7.9.1-7.9.5, the transformation of the unknowns is not uniquely 
determined. 

m.<. ,!+7»l+,l; '.-7T».+7T».+-jTT»■ 

'■ “ ■- • 7i ” + W “ = lk '--TT 

7.9.2. —,1—7,1+51,1; 1,-^.,,+— 

tt “-yv t+ -vr" 


7.9.5. 7,(+2,l; „ ^ , t+ ^. „+-^ 


y 3 - 


7.9.4. y? + 3y!-3y|-yj; yi + -^. y A , 


7.9.5. lOyf; i, = 


v.. 

'W* + W f,+ W 


X2 = "i 7W 1,1 “in' yt+ ~\fW y3 ~Y^ y " 
x,= ^/W yi+ ~^ yi ~T^ y3 ~’VW yA ' 

l4_ W y,— iAio Vio y * + I^io y *' 


,== W ! ' I “W ! ' 4 ' 



Answers and Solutions 


315 


7.9.12. We give a proof by induction over n. When n = 1 the proposition 
is obviously true. Let it be true for n = k. Consider the form in k + 1 unknowns, 
and let A ft>1 be its matrix, A h the leading principal submatrix of order k. Since 

and A h are nondegenerate, by 7.4.35 the matrix A h+1 has either one posi¬ 
tive or one negative eigenvalue more than the matrix In the first case, D h+1 
has the same sign as D h , and the sequence 1, D lt . . ., D h , D h +1 has one more 
coincidence of sign than the sequence 1, D lt . . ., D h . In the second case, D k+i 
has the sign opposite to that of D h , and thus there is another sign change. 

7.9.13. Since D h . l =£ 0, X — 0 is an eigenvalue of multiplicity one of the 

leading principal submatrix A h . Let l be the number of its negative eigenvalues. 
Then according to 7.4.35, the number of negative eigenvalues equals l for A*-!, 
and l + 1 for A h ^. Hence < 0. 

7.9.16. Each of the indices of inertia equals 2. 7.9.17. The positive index 
of inertia is 1, and negative 3. 

7.9.18. The form is positive definite. 

7.9.19. The form F is reduced to F = y\ +\G where G is, however, a quad- 
ratic form in the unknowns y t , . . ., y n . 

7.9.21. For example, y^ = x 4 + x s + x», 1/* = ** + **. V» = **• 

7.9.22. For example, y t = + x t , y s = x t + x*, y, = x s . 

7.9.23. For example, = x x — x» — 2x t , y t = 2x t + x„ y a — 3x s + 

+ 2x 4 , = 4x 4 . 


2 1 -1 

7.9.28. 0 2 1 . 

0 0 1 



7.9.30. S 


2 3 4 
1 2 3 
0 1 2 
0 0 1 


12 3 4 5 
0 12 3 4 

7.9.34. 5= 0 0 1 2 3 

0 0 0 1 2 

0 0 0 0 1 


1 1/2 


1 1/2 0 

1 1^2 


7.9.36. There are n extractions of the square root. The number of operations 
of multiplication and division is expressed by a polynomial in n whose higher- 
order term equals »*/6. 

7.9.37. The solution of the system Ax = b is reduced to the solution of the 
two triangular systems of equations S'y = b and Sx = y. 

7.9.38. The solution of the two triangular systems requires O (»') of ope¬ 
rations of multiplication and division. Taking into account 7.9.36, we see that 
the square roots method is approximately twice more economical than the Gauss 
method. 

7.9.43. For an appropriate numeration, =1, 


21* 
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7.9.45. The form F is positive definite. The transformation of the unknowns 

1 2 i 12 2 

r 2 4-——-i,. z 2 = - 


1/3 1/3 


1/3 

23 = 


V2 


1/6 

■.-V2 *, 


1/6 


makes the form F normal, and the form G canonical, i.e. 5zJ + 2zf. 

7.9.46. The matrices F and G are commuting. The orthogonal transformation 
of the unknowns 


1/3 

y 3 = 


1/3 


l /6 1/6 ' 


1/6 


1/2 ' 

T x » 


makes the form F canonical, 3y? — 2y| + 6yj, and the form G canonical also, 
(—6)^5 + 6yl. 

7.9.47. The form F is negative definite. The transformation of the unknowns 

1 4, 2 5 2 2 „ 

2i= t x ‘—r ri - r * 3> z *=3*3= T a**- 3r * 

makes the form F normal, and the form G canonical, (—5)z? — 2 1\ + z\. 

7.9.48. The form G is positive definite. The transformation of the unknowns 
Vi — *i — **t y» = *t — *a. y» — *3 — *«» y* = *« makes the form G normal, 
and the form F canonical, y f + 2j/| — y§. 

7.9.49. The matrices for the forms F and G commute. The orthogonal 
transformation of the unknowns y, x, -j- y x 2 + y x 9 + y x 4 , y, = -jx,— 

1.11 1 1 1 1 . 

form F canonical, 5yf + y§— yf—yf, and the form G canonical also, y? + 5yj + 

+yi+yi- 

8.1.29. Let p (x, M) = || x — y 0 || = || x — y'„ ||, then 


yp+y' 


yp II -4- II X—yi ||) = p (X, M). 


P (*- M) < || 
Therefore 

According to 2.4.13, 
where X > 0. Hence 


x — y 0 = X (x — y 0 ') 


X llx-yjll 1 

and y 0 = yj. 

8.1.33. If the number of c does not exist, then there is such a sequence {x fc }, 
6 M such that | F (x h ) | > k. Single out of {x ft } a subsequence {x„j}, con¬ 
vergent to a certain x 0 £ M. Then by the continuity of the functional F, the 
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relation F (x k] ) F (i 0 ) must hold, and thus is contrary to the assumption that 
F (** <) — 00 ■ 

8.1.34. Put 


C = 


According to 8.1.33, the number C is finite, so if, for any x from M, this bound 
is not reached, then the functional 

C(X) = G-|F(*)| 

must be continuous on M and its values bounded, which is contrary to the 
definition of the number C. 

8.1.35. cj l = max n(x), c,= max m(x). 


8.1.36. IUIIi<||x|li<l/n||x||„ 

II * II. < II * lit < "II *11-, 

II *11- <11 *11* < l|*||«. 

8.1.37. Put c 1 equal to the least, and c a to the greatest singular value of the 
matrix P. 

8.1.41. Define the scalar product on X so that L a and L, may be orthogonal. 
Let z 0 be boundary point of A' and {z fc J, a sequence of vectors from N, conver¬ 
gent to z 0 . If z ft = x h + y h , x* 6 Mi, y k 6 M t and z„ = x„ + y 0 is the expression 
of the vector z 0 in terms of the subspaces L x and L 2 , then 

I 2* — z o I* = I *a — *» I* + I Vh “ Vo I*. 


wheme x/,-*x 0 and y k ->- y 0 . Since M x and M t are closed, x 0 € A/i, € Mti z o £ ^ 

8.1.45. The length of a vector is dual to itself with respect to the scalar 
product generating it. 

8.1.46. m* (x) = || * Mj = | a, | + . . . + | a n |. 

8.1.47. The inequality (8.1.4) for the two norms || x || p and || x || q is actu¬ 
ally the Holder inequality. 

8.1.49. It suffices to consider vectors x 0 such that m (*«) = 1. Each of these 
vectors is a boundary point of the unit sphere determined by the norm m (1). 
It is proved in the course of convex analysis that for any boundary point *• 
of a convex set M, there exists the so-called “supporting hyperolane” deter¬ 
mined by the equality Re (*, y) =c (where y is a fixed vector) such that it pos¬ 
sesses the property that Re (z 0 , y) is equal to c and Re (x, y) is less than or equal 
to c for all the other x from M. Applying this theorem to the case under consid¬ 
eration, construct the supporting hyperplane Re (x, y) = c for the given vec¬ 
tor x 0 . The vector y determining this hyperplane is the one required. 

8.2.2. Yes, if the operator in nondegenerate. 

8.2.3. In case the operator is degenerate, the statement may be invalid. 

8.2.5. Let M r = M (] T A . Being the intersection of closed sets, M, is also 

closed. Define the scalar products on the spaces under consideration. Tne com¬ 
plete pre-image of M (or M r , which is the same) is the set of the planes x+Wa, 
where x ranges over the set A +M x . Since the operator A * , considered only on Ta, 
is nondegenerate, A *M X is a closed set (see 8.2.3). Now the required statement fol¬ 
lows from 8.1.41. 

8.2.15. (a) The spectral norm of a diagonal matrix is equal to the greatest 
modulus of the diagonal elements; (b) the spectral norm of a quasi-diagonal 
matrix equals^ the greatest spectral norm of the diagonal blocks. 

8.2.17. Y n. 8.2.18. || A ||| = of + . . . + <x>. 
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8.2.23. The real (imaginary) part of a complex number z is the point nearest 
to z on the axis of reals (imaginaries). 

8.2.24. This equality is similar to the formula for the modulus of a complex 
number, z = x + iy. 

8.2.25. Let U be an arbitrary unitary matrix. Then 

|| H - U He = tr ((H — U)* (H - U)) = tr IP + n - 2 Re tr (HU). 
According to 7.6.64, 

—tr H < Re tr (HU) < tr H, 

the equality on the right occurring only if U = E, and on the left only if U = 

When H is a positive-semidefinite matrix, the statement remains valid. How¬ 
ever, the closest and farthest unitary matrices may not be unique. 

8.2.26. For a nonzero complex number z = p (cos q> + i sin q>), the number 
»i = cos qi + l sin cp is the closest, and the number r, = —(cos q> + l sin q>) 
is the farthest point of the unit circle. 

8.2.30. (a) || A Ih = max 2 | a tj |; (b) || A H® = max 2 I a ij I- The values 

of both the norms on a diagonal matrix D equal the greatest of the moduli of 
the diagonal elements d u . 

8.2.33. N (A) = M (PAP~ l ). 

8.2.35. If x = (ay . a n )T, y = (p l? . . ., p n )T, then 


II A Ho, = (max |«||).( 2 iPil). 

8.2.38. Since any matrix B of rank 1 may be represented as the product xy* 
where x and y are column vectors, then with the aid of (8.1.4), we obtain 


| tr (Axy*) | l(Ax,y)| 

M(xy*) *™”o m(x)m*(y) 


< max - (/tl) m * } = max =sM (A). 

x.wfiO m(x)m*(y) x *o m(x) 

According to 8.1.49, fora fixed vector x, a vector y can be found such that 
| (Ax, y) \ = m (Ax) m * (y). 

Selecting appropriate x, y, we can convert the above relations into equalities. 
8.2.40. The proof is given by the following chain of equalities: 


Here the statement 8.1.50 is used, i.e. m (x) coincides with the norm dual to 
m* (y). 

8.2.43. Let the given norm || A || be consistent with vector norms m (x) and 
n (x). From 8.2.42 and 8.2.39, it follows that || A || must be subordinate both to 
m (x) and n(x), so that 
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Suppose that there is no constant c such that m (x) = era (x) for any vector x. 
The norm m ( x ) may be made less than or equal to n (x) for any x by multiplying 
one of the norms by an appropriate number (according to 8.2.32, this leaves a 
subordinate norm unaltered). Moreover, m (x 0 ) = n (x 0 ) for a certain vector x 0 . 
Since the norms m (x) and n (x) are not identical by assumption, there exists 
a vector x, such that m (x,) < n (x,). We may assume that m (x 0 ) = m (x,) = 1. 
According to 8.1.49, there is a vector v such that 

(x 0 , y) = m (x 0 ) m* (y) = m* (y). 

The vector y can also be normed by the condition m* ( y) = 1. Now, for the 
matrix A = x x y*, we have 

Ax 0 = x,y*x 0 = (x 0 , y) x, = x lt 
II A || = m (x.) m* (i y •) = 1. 

However, if the representation (f)) is used for the evaluation of || A (], then 

M H (x,) > m (x,) ” U 

This contradiction shows that the norms m (x) and n fx) must be proportional. 

8.2.45. If || A || is consistent with another norm n (x) and N (A) is the corre¬ 
sponding subordinate norm, then M (A)> N (A) on the set of matrices of rank 1. 
Using representation (8.2.5), we obtain that M (A) — N (A) for all A, whence 
(see 8.2.43) it follows that the norms m (x) and n (x) are proportional. 

8.2.47. No.”'For example,^the norm 

M (A) = max {jj|| A || lf || A ||„) 

satisfies the conditions of the problem, but is consistent with the two non-pro¬ 
portional norms || x || t and || x || „ and so it cannot be subordinate. 

8.3.3. cond« (A) > 

8.3.5. It follows from 7.6.33 that if || B ||, <o n , then the matrix A + B 
is nondegenerate. Construct now a matrix B such that || B ||, = and A + B 
is a degenerate matrix. Let A = UAV be the singular value decomposition of 
the matrix A; as usual > . • • >^„ n , and X nn = an. Then the matrix 

B is of the form: B = UAV, where X,, = . . . =X n _i, n -i = 0,X nn = — a„. 

8.3.9. Let A be degenerate and Ax = 0 for a nonzero vector x. Partition 
the vector x in accordance with the partitioning of the matrix A: 



Assume that || x t || = max (|| x x ||, || x, ||, . . ., || x ft ||}. Then from the equal¬ 
ity 

—A„x, = A i,x, + . • . + + A,. j*ix /+1 + . . . + A ih x h , 



Answers and Solutions 


we obtain 

ft k 

II t, || = || A;?£ A t} x } || < || A^H J] || A, } || || r j || 

i+i i*=\ 

<(n JjiMo ii) ii *« ii <11 *» ii. 

)*=i 

This contradiction proves that A is nondegenerate. 

When m = la criterion of diagonal dominance with respect to the rows 
is obtained. 

8.3.10. The matrix A is nondegenerate. 

8.3.12. If D is a diagonal matrix made up of.the diagonal elements of the 
matrix A, then 

condoo ( D) < condoo (A) <cond» (Z>) . 


8.3.13. Using the inequalities derived in 8.3.12, we obtain 

0.9n < cond„o (A) < 1.25n. 

8.3.14. The maximum condition number is reached for the matrix 


for which 




II 1 2 4 ... 2 n ~* 2»~* 
0 1 1 2 ... 2”-* 2"-» 
0 0 11... 2 n_s 2 n_4 


0000 ... 1 1 
0 0 0 0 ... 0 1 


Therefore cond*, (R 0 ) = n2 n ~ 1 . 

8.3.15. Since || A k || = 1, the elements of all the matrices A ft are bounded 
in absolute value. All minors of order n — 1 of these matrices are therefore also 
bounded. Hence an increase in the condition number is possible only if det A h 
tends to zero. 

8.3.18. If IM>|A,|>...>|A W |, ‘hen 

cond 2 (A) = -j£iL. 


8.3.19. cond 2 (A) = . 

ii a r E 

8.3.24. cond^A^-j^^p 
8.3.29. cond, (A) = condj (S). 


I a . 11 2 ~i~ I <*121 2 H~ I On 1 2 -r IQ 22 1 2 
l a ll a 22— a 12°2ll 
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8.3.30. For the original system of equations, cond 2 (A) > 1000. The solution 
is: x, = 1.5, Xj = 1, x, = -1. 

8.3.31. The estimate cond ? (A) >363 for matrix A of the original system 
of equations using the inequalities of Problem 7.6.28. To decrease the condition 
number, multiply the second equation of the system by 10, and the third by 
100, then substitute the variables: y 1 = x lt y s = 10x t , y , = 100x 8 . A system 
with a symmetric matrix will be obtained , its solution being y, = — 1 , y t = — 1 , 
y t = —1. Therefore the solution of the original system is: x x = —1, x* = —0.1, 
x 3 = —0.01. 

8.3.33. The components of the solution can be changed hy 6.01. The solution 
of the original system is: x = — 1, y = 0. The solution of the perturbed system 
is: x = 1, y = 1. 

8.3.34. cond^ (A) = 10 967. The solution of the original sistem is: x=l, 
y— 1. The solution of the perturbed system is: x = — 12.9, y = — 20. The 
perturbation of the system: x — x = 13.9, y — y = 21. 

8.3.35. For example, x x = 2, x, = —1, x 3 = 2, x 4 = 1. 

8.3.36. For example, x 3 =1, x, = x, = x 4 = 0. 

8.4.2. For example, the circle | z | <1^5 + Y%- 

8.4.6. This inequality determines an interval within which the eigenvalues 
are located, and the bisection method may be started with it. 

8.4.8. Let P~ l A a P = A, where A is a diagonal matrix made up of the eigen¬ 
values of the matrix A 0 . Any of the norms || P ml AP ||,. t ,oo (see 8.2.10, (c)) may 
be taken as the required norm ]| A |[. 

8.4.13. Let A = H t + iH . be the Hermitian decomposition, and B = 
— U*A U the Schur form for the matrix A. Then the Hermitian decomposition 
of the matrix B is: 

B = V*H l U + iV*H t U = Hi + iH t . 

The principal diagonal of the matrices Hi and H t contains the numbers c^, ... 

. . ., a„ and p,, . . ., P n , respectively. Therefore 2 II U*HiU ||e = 

= II #i 111 = t || A + A * ||e. The numbers P,, . . ., P„ satisfy a similar 
relation. 4 J!, 

8.4.14. As regards the relations (8.4.3), the equality4 2-«* = || A + A* ||^ 

means (see the solution to 8.4.13) that H, is a diagonal matrix. Since Hi = 
= -j (B + B*) and B is a triangular matrix, it follows from the off-diagonal 

elements of Hj being zero that the same holds for B. Hence A is a normal matrix. 

8.4.15. For matrices A of simple structure. 

8.4.16. According to 6.2.7, the matrices AB and BA have the same eigen¬ 
values X,, . . ., X„. Since AB is a normal matrix, 

II A B ||^=5] || X, |P. 

Show that || BA || E = || AB || E , whence (due to 8.4.14) the normality of the 
matrix BA follows. Really, 

II BA |I E = l r (BA (BA)*) = tr (BAA*B*)=\t (AA*B*B) 

= tr (A*Afl#*) = tr (B*A*AB)= tr ({AB)*AB) = || AB |||. 

Here both the normality of the matrices A and B and the equality tr ( XY) = 
= tr (XX) are used. 
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8.4.18. In 7.6.64, it was derived that ot, + . . . + a„ = | tr (AW) |, 

where W is an arbitrary unitary matrix. Let B = U*A U be the Schur form 
of the matrix A. Then tr (AW) = tr (UBU*W) = tr (BU*WU). Determine W 0 
from the relation U*W 0 U = D, where D is a diagonal unitary matrix such that 
bffd lt = I I = I Xi|. For the matrix Wq (which is not unique if there is a zero 
among the Xj), tr (A H^ 0 ) = | X, | + . .. -j- ) X n I, whence the required inequality. 

8.4.19. The statement follows from 8.2.13, 8.2.27 and 8.4.18. 

8.4.20. If 

l*-««ll>f>.7l, 1 = 1» •••. 

j-1 


then the matrix zE — A is diagonally dominant and therefore nondegenerate. 
Hence z may not be an eigenvalue of the matrix A. 

8.4.21. This region consists of the three discs: | z — 1.23 | < 0.07, | z — 
— 2.17 | < 0.04, | z - 3.06 | < 0.06. 

8.4.23. This region consists of the three discs: | z — Xj | < 0.012, I = 1, 2, 3, 
where ^ = 0.5, X, = 1, X, = 2.5. 

8.4.24. For example, the region consisting of the three discs: | z — X. | < 
< 45e, 1 = 1,2, 3, where X x = —1, X, = 0, X, = 1. 

8.4.27. For example, X, = -0.5,1, = — 1, X, = 0.5, X 4 = 1. 

8.4.29. For example, \ = X, = —1, X s =1, X. = 3. 

8.4.32. To prove (a), replace the elements a lt , a n and Oj 8 , a u by zeroes. The 
spectral norm of the corresponding perturbation matrix equals 2IN, whence 
(a) follows. 

To prove (b), consider the matrix A as a perturbation of the quasi-diagonal 
matrix D with the diagonal blocks 


1 0 0 

D n = 0 10, 
0 0 1 




For the perturbation matrix B = A — D || B || 2 < || B ||„ ■■ 3/AT. Therefore, 
at least three eigenvalues of the matrix lie in the interval 

-3/7V X — 1 3 IN. (a) 


To show that there are precisely three eigenvalues, prove that when N > 10, 
the interval (a) does not intersect the other intervals of the system | x — X ( | < 
< 3 IN, 1=1, .... n, X| being the eigenvalues of the matrix D. 

This is clear for the interval | z — 2 | < 3 IN < 0.3. Note now that accord¬ 
ing to the Gershgorin theorem, the eigenvalues Xj, X,, X 8 of the matrix D t9 
lie in the intervals [ — 1.3, —0.7], [—0.8, —0.2], and [1.7, 2.3]. Hence when 
N 10 the intervals | x — X ( | 3 IN < 0.3, 1 = 6, 7, 8 remain separate from 

the interval (a). 

8.4.36. The vector r (z) x is the projection of the vector Ax on L (z). 

8.4.38. Since | a |’ + || z ||| = 1, p 0 = Ho I a I 2 + Ho II 2 ||§. On the other 
hand, p 0 = (Ax, x) = Xi | a |* + (Az, z). Henc e | Xj — p 0 | | o |* = | (Az, 
*) — Ho II * III I < e’/a. Since | a | > l — e 2 /o 2 , the required estimate is 
proved. 

8.4.39. (a) For example, ^ = 1, X, = 2, X s = 3, X 4 = 4; (b) the unit col¬ 
umn vectors. 



Answers and Solutions 


323 


8.4.42. (a) If Z = X" 1 and z. is the <-th row of the matrix Z, then z t *= y t 
is the eigenvalue of the matrix A * associated with the eigenvalue X t . Moreover, 
it follows from the matrix equality XZ = E that (x t , y t ) = 1 and | s t | _l = 
= || x t ||, || y t ||,. Now, from 7.6.28 deduce that cond, (X) = || X ||, || X -1 ||, > 

> II II* II yi II* = i/I *t I; _ 

(b) select vectors x t such that || x t ||, =1 lY_\ji I- Then for the rows z t of 
the matrix X -1 , we obtain || z t ||, = \l}f\ s t |. Therefore 

cond E (X)-||X|| E ||X-»|lB = IIX|li =2 • 

i=l 

8.4.44. Without loss of generality, the vectors x and y may be assumed to 
normed. Let C = Q*AQ be an upper Schur form of the matrix A selected 
that e lx = V According to 7.1.47, such a form may be constructed in whi 
the vector x may be chosen as the first column of the matrix Q. Then the vector 
* = Q*y is an eigenvector of C*, and (e, f i) = (Q*x, Q*y) — (*, y) = 0. 
Thus, the first component of the vector z equals zero, and the required statement 
follows from 8.4.43. 

8.4.45. From the condition C*y = X^y, we obtain that ee* + CJ.jz = X x z or 

c *-‘ z+ 'T^jTF^ (> +T^p <* 2 *) 2 = l ' z ' 

Hence the statement of the problem follows. 
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